Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-6856

Consumer Group hung in initialization/bad state

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 1.0.0
    • Component/s: None
    • Labels:
      None

      Description

      All attempts to use a consumer group for any topic fail. 

      When trying to use kafka-consumer-groups.sh on the given consumer group, it responds with message waiting for group to initialize. We are not sure how to delete the consumer group, since we have removed all topics associated with the group as well as ceased all activity to the group, and removed all consumers, we thought it should have automatically been removed.

      Not sure what logs to look at to get additional information.

       

      Example of commands. 1st is failure example, 2nd is good example:

      1. ./kafka-consumer-groups.sh --bootstrap-server hs22n56.gpfs.net:9092 --describe --group 158_6372129557625143312_audit --command-config group.properties
        Note: This will not show information about old Zookeeper-based consumers.

      Error: Executing consumer group command failed due to The consumer group command timed out while waiting for group to initialize:
      #

       

      1. ./kafka-consumer-groups.sh --bootstrap-server hs22n56.gpfs.net:9092 --describe --group 151_6372129557625143312_audit --command-config group.properties
        Note: This will not show information about old Zookeeper-based consumers.

      TOPIC PARTITION CURRENT-OFFSET LOG-END-OFFSET LAG CONSUMER-ID HOST CLIENT-ID
      151_6372129557625143312_296_audit 1 4 3 -1 rdkafka-bdd44f7b-477f-4a54-ae0d-c4723679e235 /192.168.116.115 rdkafka
      151_6372129557625143312_296_audit 2 1 0 -1 rdkafka-df457bde-9e3e-4279-b9a9-04162c8502f3 /192.168.116.165 rdkafka
      151_6372129557625143312_296_audit 0 1 0 -1 rdkafka-b4a7fe4a-9a73-411c-9be0-e7a8da088946 /192.168.105.138 rdkafka
      151_6372129557625143312_296_audit 3 1 0 -1 rdkafka-f00084f4-4cc9-42e2-b8c8-13e1c9f1e71c /192.168.116.116 rdkafka
      #

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              ttosseth Todd
            • Votes:
              3 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated: