[KAFKA-6952] LogCleaner stopped due to org.apache.kafka.common.errors.CorruptRecordException

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.11.0.2
• Component/s: core
• Assignee: Unassigned
• Reporter: evan einst
• Created: 26/May/18 13:49
• Updated: 11/Jun/18 11:14

Description

This error occur our prd cluster 0.10.2.1 upgrading to the 0.11.0.2 version,  here said(https://issues.apache.org/jira/browse/KAFKA-5431)

that in the 0.11.0.0 version is fixed this error, we decided to upgrade to 0.11.0.2 version, but after upgrading the code of a server, this problem still occured.

------------------------------------------------------------------------------------

[2018-05-26 13:23:58,029] INFO Cleaner 0: Beginning cleaning of log __consumer_offsets-42. (kafka.log.LogCleaner) [2018-05-26 13:23:58,029] INFO Cleaner 0: Building offset map for __consumer_offsets-42... (kafka.log.LogCleaner) [2018-05-26 13:23:58,050] INFO Cleaner 0: Building offset map for log __consumer_offsets-42 for 19 segments in offset range [0, 6919353). (kafka.log.LogCleaner) [2018-05-26 13:23:58,300] ERROR [kafka-log-cleaner-thread-0]: Error due to (kafka.log.LogCleaner) org.apache.kafka.common.errors.CorruptRecordException: Record size is less than the minimum record overhead (14) [2018-05-26 13:23:58,301] INFO [kafka-log-cleaner-thread-0]: Stopped (kafka.log.LogCleaner)

------------------------------------------------------------------------------------

Please help me resolve this problem, thank you very much!