[KAFKA-3000] __consumer_offsets topic grows indefinitely

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 0.8.2.1
• Component/s: offset manager
• Environment: Ubuntu 14.04, 5 node kafka cluster + 5 node ZooKeeper cluster. ZooKeeper and Kafka coexist on 5 cloud boxes.
• Assignee: Grant Henke
• Reporter: Maxim Vladimirskiy
• Created: 16/Dec/15 23:09
• Updated: 16/Dec/15 23:56
• Resolved: 16/Dec/15 23:43

Description

Old segments of the __consumer_offsets topic seem to be never deleted. As of Dec 16, 2015, there are segments dating back to when we started use Kafka - Oct 26, 2015. However the idx for the respective oldest segment file is just about an hour fresh. All offset related settings are default.

Issue Links

• relates to: KAFKA-2988 Change default configuration of the log cleaner