[KAFKA-17035] Add debug log to retention cleanupLogs method to help troubleshoot issues

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Kuan Po Tseng
• Reporter: Luke Chen
• Created: 25/Jun/24 09:37
• Updated: 25/Jun/24 09:45

Description

Sometimes, there will be some log segments leftover without getting deleted as configured. One example is, the config is set to retention.ms = 7 days, but there are some log segments stay in storage for more than 7 days. In this case, it's difficult to troubleshoot if there is a bug in kafka or something wrong in the log segment (ex: max time is wrongly set).

To help troubleshooting, we could add "trace level" or "debug level" logs when doing retentionSize/retentionMs/logStartOffset check for each log segment.

Issue Links

• is related to: KAFKA-17020 After enabling tiered storage, occasional residual logs are left in the replica