[KAFKA-14837] The MirrorCheckPointConnector of MM2 will rebalance frequently, when the source cluster group is many more and changes frequently (but the list of configured synchronous group does not change)

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.2
• Fix Version/s: 3.5.0, 3.4.1, 3.3.3
• Component/s: connect, mirrormaker
• Assignee: hudeqi
• Reporter: hudeqi
• Created: 23/Mar/23 14:15
• Updated: 31/Jul/24 19:44
• Resolved: 28/Mar/23 13:20

Description

In practice, I found that when I configure a mirror checkpoint connector, because the source cluster has a large number of group or the number of group under a topic changes frequently, the connector will frequently rebalance between its tasks, although there is no change in the synchronized group list of the configuration. 
I don't think connector should rebalance frequently in this case to affect  group synchronization tasks without any group changes.

Issue Links

• Blocked: KAFKA-14842 MirrorCheckpointTask can reduce the rpc calls of "listConsumerGroupOffsets(group)" of irrelevant groups at each poll
• relates to: KAFKA-17233 MirrorCheckpointConnector should use batched listConsumerGroupOffsets
• links to: GitHub Pull Request #13446