Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3659

Consumer does not handle coordinator connection blackout period gracefully

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0.0, 0.9.0.1
    • Fix Version/s: 0.10.0.0
    • Component/s: consumer
    • Labels:
      None

      Description

      Currently when the connection to the coordinator is closed, the consumer will immediately try to rediscover the coordinator and reconnect to it. This is fine as it is, but the NetworkClient enforces a blackout period before it will allow the reconnect to be attempted. This causes the following cycle which continues in a fairly tight loop until the blackout period has completed:

      1. Notice connection failure (i.e. DISCONNECTED state in ConnectionStates)
      2. Send GroupCoordinator request to rediscover coordinator.
      3. Attempt to connect to coordinator.
      4. Go back to 1.

      To fix this, we should avoid rediscovery while the connection is blacked out.

        Attachments

          Activity

            People

            • Assignee:
              hachikuji Jason Gustafson
              Reporter:
              hachikuji Jason Gustafson
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: