In Lenses, I see each partition has total bytes as 5 MB whereas my retention.bytes = 1 MB and retention = 1d.
Why do we have more total bytes in each partition than what I have in retention.bytes.
As per this document
https://cloud.ibm.com/docs/EventStreams?topic=EventStreams-ES_understanding_reserved_disk_usage
The retention.bytes configuration is the total number of bytes allocated for messages for each partition of the topic. Once exceeded, Kafka will delete oldest messages.
Is this because the clean up process has not kicked in yet ?