Description
I have a use case where tiered storage plugin received requests for active segments. The topics for which it happened were historically compacted topics for which compaction was disabled and tiering was enabled.
Create topic with compact cleanup policy -> Produce data with few repeat keys and create multiple segments -> let compaction happen -> change cleanup policy to delete -> produce some more data for segment rollover -> enable tiering on topic -> wait for segments to be uploaded to remote storage and cleanup from local (active segment would remain), consume from beginning -> Observe logs.
Attachments
Issue Links
- is a child of
-
KAFKA-16947 Kafka Tiered Storage V2
-
- Open
-
- is related to
-
KAFKA-15388 Handle topics that were having compaction as retention earlier are changed to delete only retention policy and onboarded to tiered storage.
-
- Patch Available
-