source code of project
I found that there are two ways to manage Kafka Service,
DocumentLambda and KafkaRunner.
They are very similar, and I want to know more about the differences. And the reason or the history of why it is like this
How to understand SequencedLambda(KafkaRunner) and DocumentPartition(DocumentLambda),and their related, in fluid-framework
Viewed 49
1 Answers
We use a fixed number of Kafka partitions. So, a partition is shared by multiple documents. The DocumentLambda is responsible for routing the messages inside a partition to corresponding lambda handler. It contains a HashMap where key is "tenantId/documentId". For every incoming message, it looks up those fields to determine the lambda associated with that message.
Related