Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3938

Fix consumer session timeout issue in Kafka Streams

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.10.1.0
    • Component/s: streams
    • Labels:

      Description

      After KIP-62 / KAFKA-3888 is merged in, Kafka Streams should leverage this new feature to fix the session timeout issue that can be caused by:

      1. long rebalance period due to state store restoration.
      2. exceptional long processing time for a batch of records.

      Also we need to consider:

      1. state store directory locking mechanism between rebalances while one instance is grabbing tasks from another instance on the same machine.
      2. exceptional handling in Kafka Streams: what should we really expose to users and what should be handled automatically?

        Attachments

          Issue Links

          Blocked

          Improvement - An improvement or enhancement to an existing feature or task. KAFKA-3888 Allow consumer to send heartbeats in background thread (KIP-62)

          • Major - Major loss of function.
          • Resolved
          There are no Sub-Tasks for this issue.

            Activity

              People

              • Assignee:
                guozhang Guozhang Wang
                Reporter:
                guozhang Guozhang Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: