Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-832

0.8 Consumer prevents rebalance if consumer thread is blocked or slow

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.8.0
    • 0.8.0
    • consumer

    Description

      0.8 consumer involves multiple locks across the fetcher manager, leader finder thread and the rebalance watcher executor that prevent rebalance from interrupting the consumer. Rebalance should always take precedence over consumption, not the other way around. The effect of this bug is that if a consumer is lagging and the fetcher thread is blocked on adding the next fetched data chunk to the internal blocking queue, rebalance is halted.

      Attachments

        1. kafka-832.patch
          6 kB
          Jun Rao

        Activity

          People

            junrao Jun Rao
            nehanarkhede Neha Narkhede
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: