[KAFKA-13603] empty active segment can trigger recovery after clean shutdown and restart

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.2.0
• Assignee: Cong Ding
• Reporter: Cong Ding
• Created: 20/Jan/22 02:40
• Updated: 06/Apr/22 21:45
• Resolved: 27/Jan/22 23:02

Description

Within a LogSegment, the TimeIndex and OffsetIndex are lazy indices that don't get created on disk until they are accessed for the first time. If the active segment is empty at the time of the clean shutdown, the disk will have only the log file but no index files.

However, Log recovery logic expects the presence of an offset index file on disk for each segment, otherwise, the segment is considered corrupted.

We need to address this issue: create the index files for empty active segments during clean shutdown.

Issue Links

• links to: GitHub Pull Request #11345