Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3938

Fix consumer session timeout issue in Kafka Streams

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 0.10.1.0
    • streams

    Description

      After KIP-62 / KAFKA-3888 is merged in, Kafka Streams should leverage this new feature to fix the session timeout issue that can be caused by:

      1. long rebalance period due to state store restoration.
      2. exceptional long processing time for a batch of records.

      Also we need to consider:

      1. state store directory locking mechanism between rebalances while one instance is grabbing tasks from another instance on the same machine.
      2. exceptional handling in Kafka Streams: what should we really expose to users and what should be handled automatically?

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            guozhang Guozhang Wang
            guozhang Guozhang Wang
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment