[KAFKA-6856] Consumer Group hung in initialization/bad state

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Fix Version/s: 1.0.0
• Assignee: Unassigned
• Reporter: Todd
• Created: 03/May/18 18:02
• Updated: 03/May/18 18:02

Description

All attempts to use a consumer group for any topic fail. 

When trying to use kafka-consumer-groups.sh on the given consumer group, it responds with message waiting for group to initialize. We are not sure how to delete the consumer group, since we have removed all topics associated with the group as well as ceased all activity to the group, and removed all consumers, we thought it should have automatically been removed.

Not sure what logs to look at to get additional information.

 

Example of commands. 1st is failure example, 2nd is good example:

1. ./kafka-consumer-groups.sh --bootstrap-server hs22n56.gpfs.net:9092 --describe --group 158_6372129557625143312_audit --command-config group.properties
   Note: This will not show information about old Zookeeper-based consumers.

Error: Executing consumer group command failed due to The consumer group command timed out while waiting for group to initialize:
#

 

1. ./kafka-consumer-groups.sh --bootstrap-server hs22n56.gpfs.net:9092 --describe --group 151_6372129557625143312_audit --command-config group.properties
   Note: This will not show information about old Zookeeper-based consumers.

TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID
151_6372129557625143312_296_audit 1 4 3 -1 rdkafka-bdd44f7b-477f-4a54-ae0d-c4723679e235 /192.168.116.115 rdkafka
151_6372129557625143312_296_audit 2 1 0 -1 rdkafka-df457bde-9e3e-4279-b9a9-04162c8502f3 /192.168.116.165 rdkafka
151_6372129557625143312_296_audit 0 1 0 -1 rdkafka-b4a7fe4a-9a73-411c-9be0-e7a8da088946 /192.168.105.138 rdkafka
151_6372129557625143312_296_audit 3 1 0 -1 rdkafka-f00084f4-4cc9-42e2-b8c8-13e1c9f1e71c /192.168.116.116 rdkafka
#