[KAFKA-13085] Offsets clean up based on largest Timestamp in a Log segment

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: config, log cleaner
• Assignee: Unassigned
• Reporter: Mohamed Aashif
• Created: 14/Jul/21 09:34
• Updated: 20/Dec/22 08:22

Description

This is to confirm the behaviour of retention.ms.

According to the kafka doc, a log segment is kept undeleted until the Largest timestamp of the offsets in that segment.

Initially, we thought that the Largest timestamp is considered from the created time of the record. But, it is considered from the timestamp of the ProducerRecord, which can be entered manually.

We suspect if this is intentional, as the log segment can be undeleted forever if the timestamp of a far future time is given.

Please clarify.