I am working with apache beam. My task is to pull data from kafka topic and process in dataflow.
Does dataflow support kafkaIO ?
Which runners are supported for KafkaIO ?
Which Runners support kafkaIO in apache beam?
Viewed 193
1 Answers
Yes. KafkaIO is supported by Dataflow and other major Beam runners.
We have Kafka transforms for both Java and Python SDKs.
Note that Python versions are cross-language transforms and Dataflow requires runner V2.
Related