Details
Major Description
We had set the below configuration: Retention hours as 1, Retention bytes as 150 MB in the server.properties in the Kafka Server(Version: 0.9.0.1). Also modified other settings as given below.
log.dirs=/tmp/kafka-logs
log.retention.hours=1
log.retention.bytes=157286400
log.segment.bytes=1073741824
log.retention.check.interval.ms=300000
log.cleaner.enable=true
log.cleanup.policy=delete
After checking few days, Size of the Kafka log folder too huge as 13.2 GB. We have seen that Topic Offset getting updated and ignores the Old data but Log File doesnt reduce and has all the Old Data and become too huge. Could you help us to find out why Kafka is not deleting the logs(Physically). Do we need to change any configuration ?