[KAFKA-17143] Error while deleting segments and java.nio.file.NoSuchFileException

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.4.1
• Component/s: log, log cleaner
• Flags: Important
• Assignee: Unassigned
• Reporter: Prem Kumar
• Created: 16/Jul/24 10:49
• Updated: 17/Jul/24 09:32

Description

In one of our 3 node  kafka cluster deployment we are observing crash while trying to delete log segment during retention time breach . This issue is occurring very frequently in production systems.

we are unable to find the root cause of this issue. Requesting you to help us on the same

 

Logs:

[2024-06-13 11:43:44,768] INFO [UnifiedLog partition=FMAASEVENTS-1, dir=/kafka/kafka-logs-kafka-1] Deleting segment LogSegment(baseOffset=21318, size=696800
, lastModifiedTime=0, largestRecordTimestamp=Some(1718019689005)) due to retention time 259200000ms breach based on the largest record timestamp in the segm
ent (kafka.log.UnifiedLog)
[2024-06-13 11:43:44,770] ERROR Error while deleting segments for FMAASEVENTS-1 in dir /kafka/kafka-logs-kafka-1 (kafka.server.LogDirFailureChannel)
java.nio.file.NoSuchFileException: /kafka/kafka-logs-kafka-1/FMAASEVENTS-1/00000000000000021318.log