Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2336

Changing offsets.topic.num.partitions after the offset topic is created breaks consumer group partition assignment

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8.2.1
    • 0.9.0.0
    • core
    • None

    Description

      Currently adjusting offsets.topic.num.partitions after the offset topic is created is not supported. Meaning that the number of partitions will not change once the topic has been created.

      However, changing the value in the configuration should not cause issues and instead simply be ignored. Currently this is not the case.

      When the value of offsets.topic.num.partitions is changed after the offset topic is created the consumer group partition assignment completely changes even though the number of partitions does not change.

      This is because kafka.server.OffsetManager.partitionFor(group: String) uses the configured value and not the value of the actual topic.

      Attachments

        1. KAFKA-2336.patch
          2 kB
          Grant Henke
        2. KAFKA-2336.patch
          3 kB
          Grant Henke
        3. KAFKA-2336_2015-07-16_13:04:02.patch
          3 kB
          Grant Henke
        4. KAFKA-2336_2015-08-11_10:37:41.patch
          2 kB
          Grant Henke

        Activity

          People

            granthenke Grant Henke
            granthenke Grant Henke
            Gwen Shapira Gwen Shapira
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: