How Kafka Streams API poll works and how to identify time period where there is no transactions from poll

Viewed 13

Can someone explain how poll of records from Kafka topic will work in Kafka Streams API(KStream).

My challenge is, I'm processing records as batch of 100 and I mentioned commit interval as 2 hours. There are less records in Kafka and my code processed 50 records and it is trying to get records in Kafka topic but there are no records. Now I'm not able to insert 50 records because I'm processing as a batch of 100.

Now, I need to identify that there are no transactions coming up from Kafka and I have to insert 50 records so that we can process data in real-time.

Can someone please gave suggestion on this.

0 Answers
Related