[KAFKA-7076] Broker startup could be inefficient when using old message format - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 0.11.0.0, 0.11.0.1, 0.11.0.2, 1.0.0, 1.0.1, 1.1.0
Fix Version/s: 2.0.0
Component/s: core
Labels:
None

Description

During broker startup, we call `Log#recoverSegment` when we find corrupted indexes, for segments beyond the last check-pointed recovery point, and for any ".swap" segments created by log cleaner. One of the things `Log#recoverSegments` does is to build up the producer state, starting from any previous snapshot file that is available. For logs using message formats older than V2, we could skip building up this producer state which would essentially speed up recovery.