Description
During data disk full event, there could be a situation with index corruption. There are existing functions which perform sanity checks to TimeIndex [1], TxnIndex [2], OffsetIndex [2]. The idea is performing same checks before in RemoteLogManager before we upload segment to remote storage [4].
Resources:
[1]TimeIndex::sanityCheck()
[2]TransationIndex::sanityCheck()
[3]OffsetIndex::sanityCheck()]
[4]RemoteLogManager::copyLogSegmentsToRemote()
Attachments
Issue Links
- fixes
-
KAFKA-15609 Corrupted index uploaded to remote tier
-
- Resolved
-
- is a child of
-
KAFKA-15420 Kafka Tiered Storage V1
-
- Resolved
-
- relates to
-
-
- Resolved
-
- links to
(2 links to)
