[KAFKA-5186] Avoid expensive initialization of producer state when upgrading - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Blocker
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.11.0.0
Component/s: clients, core, producer
Labels:
- exactly-once

Description

Currently the producer state is always loaded upon broker initialization. If we don't find a snapshot file to load from, then we scan the log segments from the beginning to rebuild the state. Of course, when users upgrade to the new version, there will be no snapshot file, so the upgrade could be quite intensive. It would be nice to avoid this by assuming instead that the absence of a snapshot file means that the producer state should start clean and we can avoid the expensive scanning.