[KAFKA-12997] Expose log record append time to the controller/broker - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Minor
Resolution: Fixed
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:
- kip-500

Description

The snapshot records are generated by each individual quorum participant which also stamps the append time in the records. These appends times are generated from a different clock (except in the case of the quorum leader) as compared to the metadata log records (where timestamps are stamped by the leader).

To enable having a single clock to compare timestamps, https://issues.apache.org/jira/browse/KAFKA-12952 adds a timestamp field to the snapshot header which should contain the append time of the highest record contained in the snapshot (which will be in leader time).

This JIRA tracks exposing and wiring the batch timestamp such that it can be provided to the SnapshotWriter at the time of snapshot creation.