Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3938

Fix consumer session timeout issue in Kafka Streams

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.10.1.0
    • streams

    Description

      After KIP-62 / KAFKA-3888 is merged in, Kafka Streams should leverage this new feature to fix the session timeout issue that can be caused by:

      1. long rebalance period due to state store restoration.
      2. exceptional long processing time for a batch of records.

      Also we need to consider:

      1. state store directory locking mechanism between rebalances while one instance is grabbing tasks from another instance on the same machine.
      2. exceptional handling in Kafka Streams: what should we really expose to users and what should be handled automatically?

      Attachments

        Issue Links

          Activity

            People

              guozhang Guozhang Wang
              guozhang Guozhang Wang
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: