Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-7739 Kafka Tiered Storage
  3. KAFKA-15260

RLM Task should wait until RLMM is initialized before copying segments to remote

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • 3.6.0
    • None
    • None

    Description

      The RLM Task uploads segment to the remote storage for its leader partitions and after each upload it sends a message 'COPY_SEGMENT_STARTED' to the Topic based RLMM topic and then waits for the TBRLMM to consume the message before continuing.

      If the RLMM is not initialized, TBRLMM may not be able to consume the message within the stipulated time and timeout and RLMM will repeat later. It make take a few mins for the TBRLMM to initialize during which RLM Task will keep timing out.

      Instead the RLM task should wait until RLMM is initialized before attempting to copy segments to remote storage.

       

      Attachments

        Issue Links

          Activity

            People

              abhijeetkumar Abhijeet Kumar
              abhijeetkumar Abhijeet Kumar
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: