Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-2336

Changing offsets.topic.num.partitions after the offset topic is created breaks consumer group partition assignment

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8.2.1
    • 0.9.0.0
    • core
    • None

    Description

      Currently adjusting offsets.topic.num.partitions after the offset topic is created is not supported. Meaning that the number of partitions will not change once the topic has been created.

      However, changing the value in the configuration should not cause issues and instead simply be ignored. Currently this is not the case.

      When the value of offsets.topic.num.partitions is changed after the offset topic is created the consumer group partition assignment completely changes even though the number of partitions does not change.

      This is because kafka.server.OffsetManager.partitionFor(group: String) uses the configured value and not the value of the actual topic.

      Attachments

        1. KAFKA-2336_2015-07-16_13:04:02.patch
          3 kB
          Grant Henke
        2. KAFKA-2336_2015-08-11_10:37:41.patch
          2 kB
          Grant Henke
        3. KAFKA-2336.patch
          3 kB
          Grant Henke
        4. KAFKA-2336.patch
          2 kB
          Grant Henke

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            granthenke Grant Henke
            granthenke Grant Henke
            Gwen Shapira Gwen Shapira
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment