[KAFKA-561] Rebuild index file for a log segment if there is none

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.8.1
• Assignee: Jay Kreps
• Reporter: Jay Kreps
• Created: 09/Oct/12 21:46
• Updated: 03/Mar/14 17:38
• Resolved: 06/Dec/12 05:13

Description

There are two ways an index file could be missing:
1. Someone could delete it or it could be lost due to file corruption
2. The server could crash in the middle of rolling the log after having created the new log segment but before having created the corresponding index segment.

Regardless it would be nice to recover gracefully from this and rebuild the index segment off the corresponding log segment if this happened. This will be slow.

This should be done after KAFKA-521.