Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-16061 KRaft JBOD follow-ups and improvements
  3. KAFKA-16082

Broker recreates reassigned partition after logdir failure

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 3.7.0
    • 3.8.0, 3.7.1
    • jbod
    • None

    Description

      There is a possible dataloss scenario

      when using JBOD,

      when moving the partition leader log from one directory to another on the same broker,

      when after the destination log has caught up to the source log and after the broker has sent an update to the partition assignment

      if the broker accepts and commits a new record for the partition and then the broker restarts and the original partition leader log is lost

      then the destination log would not contain the new record.

      Attachments

        Activity

          People

            gnarula Gaurav Narula
            pprovenzano Proven Provenzano
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: