Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-15660

File-based Tiered Storage should delete folders upon topic deletion

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.6.0
    • None
    • None
    • None

    Description

      We have added a quick-start guide for Tiered Storage as part of Apache Kafka 3.6 - https://kafka.apache.org/documentation/#tiered_storage_config_ex.

      When interacting with it, however, it appears that when topics are deleted while remote segments and their indecies are deleted the folders are not:

      > ls /tmp/kafka-remote-storage/kafka-tiered-storage 
A-0-ApBdPOE1SOOw-Ie8RQLuAA  B-0-2omLZKw1Tiu2-EUKsIzj9Q  C-0-FXdccGWXQJCj-RQynsOK3Q  D-0-vqfdYtYLSlWEyXp6cwwmpg

> ls /tmp/kafka-remote-storage/kafka-tiered-storage/A-0-ApBdPOE1SOOw-Ie8RQLuAA


> bin/kafka-topics.sh --bootstrap-server localhost:9092 --list
__remote_log_metadata

      I think that the file-based implementation shipping with Kafka should delete the folders as well.

      Attachments

        Issue Links

          is a child of

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-16947 Kafka Tiered Storage V2

          • Major - Major loss of function.
          • Open
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-15166 Add deletePartition API to the RemoteStorageManager

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              christo_lolov Christo Lolov
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: