Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-17665

Kafka Tiered Storage retry back off is not used

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • 4.0.0
    • core, Tiered-Storage
    • None

    Description

      Hi, we are evaluating the Kafka Tiered Storage. We already see KAFKA-17062 which under 3.9 we could have data loss. I was looking at the code and also the KIP-405. 

       

      On the KIP it is mentioned that if a copy fails it will be retried with a backoff propagation defined on REMOTE_LOG_MANAGER_TASK_RETRY_BACK_OFF_MS_PROP.  The issue is the method  remoteLogManagerTaskRetryBackoffMs() is not used in any place of the code. So I think this parameters make no effect currently. Is there any retry of failed segments ? Until now I just saw logging the error.

      Another question from me:  What happen to segments that have the state  COPY_SEGMENT_STARTED between server restarts?

       

       

      Attachments

        Activity

          People

            Unassigned Unassigned
            jomach Jorge Machado
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated: