Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-13397

MirrorMaker2 shouldn't mirror Connect's internal topics

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 3.1.0, 3.2.0
    • mirrormaker
    • None

    Description

      This issue is a follow-up of KAFKA-10777 (KIP-690).

      As of present, a user can set custom 'replication.policy.separator' configuration in MirrorMaker 2. It determines the topic name of internal topics like heartbeats, checkpoints, and offset-syncs (KIP-690).

      However, there are some glitches here:

      1. MirrorMaker2 creates internal topics to track the offsets, configs, and status of the MM2 tasks. But, these topics are not affected by a custom 'replication.policy.separator' settings - that is, these topics may be replicated against the user`s intention.
      2. The internal topic names include a dash in their name (e.g., 'mm2-offsets.{source}.internal') so, a single '-' should be disallowed when configuring 'replication.policy.separator'.

      Attachments

        Issue Links

          Activity

            People

              dongjin Dongjin Lee
              dongjin Dongjin Lee
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: