[KAFKA-4972] Kafka 0.10.0 Found a corrupted index file during Kafka broker startup

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 0.10.0.0
• Component/s: log
• Labels: reliability
• Environment: JDK: HotSpot x64 1.7.0_80 ; Tag: 0.10.0
• Assignee: Unassigned
• Reporter: fangjinuo
• Created: 29/Mar/17 07:31
• Updated: 14/Mar/20 11:26

Description

-deleted text-After force shutdown all kafka brokers one by one, restart them one by one, but a broker startup failure.

The following WARN leval log was found in the log file:
found a corrutped index file, xxxx.index , delet it ...

you can view details by following attachment.

~I look up some codes in core module, found out :

the nonthreadsafe method LogSegment.append(offset, messages) has tow caller:

1) Log.append(messages) // here has a synchronized lock
2) LogCleaner.cleanInto(topicAndPartition, source, dest, map, retainDeletes, messageFormatVersion) // here has not

So I guess this may be the reason for the repeated offset in 00000xx.log file (logsegment's .log) ~

Although this is just my inference, but I hope that this problem can be quickly repaired

Issue Links

• links to: GitHub Pull Request #4016