[KAFKA-15564] Kafka 3.5.1- Mirror Maker 2 replicating the wrong consumer group offsets in destination

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.5.1
• Component/s: mirrormaker
• Assignee: Unassigned
• Reporter: Hemanth Savasere
• Created: 07/Oct/23 12:09
• Updated: 27/Nov/23 19:10

Description

Issue : Mirror Maker 2 not replicating the proper consumer group offsets when replication happens from source to destination kafka brokers

Steps to Reproduce :

1. Created 2 Kafka clusters locally using the attached docker-compose.yml file. Was using the confluent platform 7.2.1 docker images
2. Had added the below section in docker file to create 20 topics and produce randomly between 1000 to 2000 messages in each topic, and then consume the same messages using consumer-groups.

   /etc/confluent/docker/run &
           sleep 20
           for i in {1..20}; do
             kafka-topics --create --bootstrap-server kafka-1:9092 --replication-factor 1 --partitions 1 --topic topic$$i
           done
           for i in {1..20}; do
             num_msgs=$$(shuf -i 1000-2000 -n 1)
             seq 1 $$num_msgs | kafka-console-producer --broker-list kafka-1:9092 --topic topic$$i
           done
           for i in {1..20}; do
             timeout 10 kafka-console-consumer --bootstrap-server kafka-1:9092 --topic topic$$i --group consumer-group$$i
           done
           wait 
   

3. Ran the Mirror Maker 2 using the connect-mirror-maker.sh script after downloading the Kafka 3.5.1 release binaries. Verified the 3.5.1 version was running and commitID 2c6fb6c54472e90a was shown in attached MM2 logs file.

NOTE : Have attached the Kafka Docker file, the mirror maker 2 logs and mirror maker 2 properties file. Also, have attached the describe command output of all the consumer groups present in source and destination.

Issue Links

• relates to: KAFKA-15906 Emit offset syncs more often than offset.lag.max for low-throughput/finite partitions