Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
SAMZA-1427 introduced a performance regression with KafkaCheckpointManager.
We invoke the checkpoint manager once for each task and the old code would only read the delta for each subsequent call. The SAMZA-1427 code would reread the entire checkpoint topic for each call.
This effect is even worse when log compaction is not running on the broker.
Attachments
Issue Links
- links to