Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-16454

Snapshot the state of remote log metadata for all the partitions

    XMLWordPrintableJSON

Details

    • Task
    • Status: Open
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None

    Description

      When restarting the broker, we are reading from the beginning of the __remote_log_metadata topic to reconstruct the state of remote log segments, instead we can snapshot the state of remote log segments under each partition directory.

      Previous work to snapshot the state of the remote log metadata are removed as the solution is incomplete:

      https://github.com/apache/kafka/pull/15636

      Attachments

        Issue Links

          is a child of

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-16947 Kafka Tiered Storage V2

          • Major - Major loss of function.
          • Open

          Activity

            People

              Unassigned Unassigned
              ckamal Kamal Chandraprakash
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: