[KAFKA-17321] Kafka 1.1.1 consumer cannot get any topic-partition

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 1.1.1
• Component/s: consumer
• Labels: consumer group-coordinator
• Environment: Kafka 1.1.1 with Scala 2.11
• Flags: Important
• Assignee: Unassigned
• Reporter: YI ZHAOPU
• Due: 13/Aug/24
• Created: 13/Aug/24 02:20
• Updated: 19/Aug/24 22:23

Description

We are using Kafka 1.1.1, in one day that our consumers (using subscribe mode) restarted themselves, but during the rebalance, consumers could assign topic-partitions until generation 229, after generation 229, the logs shown that the consumer could not get any topic-partition, event if we tried to restart consumer in order to trigger rebalance again, but it had no effect, logs shown that there were still no partition(Setting newly assigned partitions []).

But both Kafka coordinator and consumer did not show any exception logs and error, it just rebalance the group as normal.

The solution was we restarted the Group Coordinator, which trigger the broker high availability switch, let the leader of the __consumer_offsets switch to another broker and switch back, once the coordinator switched, that problem was solve immediately.

Is there anyone meet similar problem before?  Can anybody explain this thing?

Very Thanks.