Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-5787

StoreChangeLogReader needs to restore partitions that were added post initialization

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • 0.11.0.1, 1.0.0
    • 0.11.0.1, 1.0.0
    • streams
    • None

    Description

      Investigation of KStreamRepartitionJoinTest failures uncovered this bug. If a task fails during initialization due to a LockException, its changelog partitions are not immediately added to the StoreChangelogReader as the thread doesn't hold the lock. However StoreChangelogReader#restore will be called and it sets the initialized flag. On a subsequent successfull call to initialize the new tasks the partitions are added to the StoreChangelogReader, however as it is already initialized these new partitions will never be restored. So the task will remain in a non-running state forever

      Attachments

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. KAFKA-5769 Transient test failure org.apache.kafka.streams.integration.KStreamRepartitionJoinTest.shouldCorrectlyRepartitionOnJoinOperationsWithZeroSizedCache

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link GitHub Pull Request #3736

          Web Link GitHub Pull Request #3747

          Activity

            People

              damianguy Damian Guy
              damianguy Damian Guy
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: