How to get rid of negative consumer lag in Kafka

Viewed 9118

Recently I monitor my cluster and I saw the negative consumer lag on it:

enter image description here

This negative lag affects the sink connectors on the cluster and I got this error on the Kafka-Connect:

Mar 25 15:56:30 Master1 connect-distributed[14530]: [2020-03-25 15:56:30,910] WARN WorkerSinkTask{id=hdfs-1} Ignoring invalid task provided offset mongodb.db.collection-1/OffsetAndMetadata{offset=84, leaderEpoch=null, metadata=''} -- not yet consumed, taskOffset=84 currentOffset=7 (org.apache.kafka.connect.runtime.WorkerSinkTask:417)

0 Answers
Related