Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-16003

The znode /config/topics is not updated during KRaft migration in "dual-write" mode

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.6.1
    • 3.8.0, 3.7.1
    • controller
    • None

    Description

      I tried the following scenario ...

      I have a ZooKeeper-based cluster and create a my-topic-1 topic (without specifying any specific configuration for it). The correct znodes are created under /config/topics and /brokers/topics.

      I start a migration to KRaft but not moving forward from "dual write" mode. While in this mode, I create a new my-topic-2 topic (still without any specific config). I see that a new znode is created under /brokers/topics but NOT under /config/topics. It seems that the KRaft controller is not updating this information in ZooKeeper during the dual-write. The controller log shows that the write to ZooKeeper was done, but not everything I would say:

      2023-12-13 10:23:26,229 TRACE [KRaftMigrationDriver id=3] Create Topic my-topic-2, ID Macbp8BvQUKpzmq2vG_8dA. Transitioned migration state from ZkMigrationLeadershipState{kraftControllerId=3, kraftControllerEpoch=7, kraftMetadataOffset=445, kraftMetadataEpoch=7, lastUpdatedTimeMs=1702462785587, migrationZkVersion=236, controllerZkEpoch=3, controllerZkVersion=3} to ZkMigrationLeadershipState{kraftControllerId=3, kraftControllerEpoch=7, kraftMetadataOffset=445, kraftMetadataEpoch=7, lastUpdatedTimeMs=1702462785587, migrationZkVersion=237, controllerZkEpoch=3, controllerZkVersion=3} (org.apache.kafka.metadata.migration.KRaftMigrationDriver) [controller-3-migration-driver-event-handler]
      2023-12-13 10:23:26,229 DEBUG [KRaftMigrationDriver id=3] Made the following ZK writes when handling KRaft delta: {CreateTopic=1} (org.apache.kafka.metadata.migration.KRaftMigrationDriver) [controller-3-migration-driver-event-handler] 

      Attachments

        Issue Links

          Activity

            People

              mimaison Mickael Maison
              ppatierno Paolo Patierno
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: