Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2336

Changing offsets.topic.num.partitions after the offset topic is created breaks consumer group partition assignment

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.8.2.1
    • Fix Version/s: 0.9.0.0
    • Component/s: core
    • Labels:
      None

      Description

      Currently adjusting offsets.topic.num.partitions after the offset topic is created is not supported. Meaning that the number of partitions will not change once the topic has been created.

      However, changing the value in the configuration should not cause issues and instead simply be ignored. Currently this is not the case.

      When the value of offsets.topic.num.partitions is changed after the offset topic is created the consumer group partition assignment completely changes even though the number of partitions does not change.

      This is because kafka.server.OffsetManager.partitionFor(group: String) uses the configured value and not the value of the actual topic.

        Attachments

        1. KAFKA-2336.patch
          2 kB
          Grant Henke
        2. KAFKA-2336.patch
          3 kB
          Grant Henke
        3. KAFKA-2336_2015-07-16_13:04:02.patch
          3 kB
          Grant Henke
        4. KAFKA-2336_2015-08-11_10:37:41.patch
          2 kB
          Grant Henke

          Activity

            People

            • Assignee:
              granthenke Grant Henke
              Reporter:
              granthenke Grant Henke
              Reviewer:
              Gwen Shapira
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: