Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-14095

Improve handling of sync offset failures in MirrorMaker

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.4.0
    • mirrormaker
    • None

    Description

      MirrorMaker can automatically sync offsets when sync.group.offsets.enabled is set to true. However that only works if the consumer groups are not used in the target cluster otherwise committing offsets fails with UNKNOWN_MEMBER_ID.

      Currently we treat this case as an error in the admin client so it emits an ERROR level log line. This is misleading as it's not an unexpected error and we should treat it the same way as other group level error codes.

      In addition we should check the result of the alterConsumerGroupOffsets call in MirrorMaker and provide an helpful message in case of UNKNOWN_MEMBER_ID errors.

      Attachments

        Issue Links

          Activity

            People

              mimaison Mickael Maison
              mimaison Mickael Maison
              Chris Egerton Chris Egerton
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: