Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4319

AbstractFetcherManager shutdown speedup

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.10.2.0
    • Component/s: None
    • Labels:
      None

      Description

      While a shutdown proccess, AbstractFetcherManager closed all worker-threads sequentially which slows the final time of shutdown dramatically on huge clusters (approximately 15 minutes for 100 nodes, for example).

      This can be improved by parallel mode. On the first stage AbstractFetcherManager can send the stop signal and then join all the workers to the thread

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                aozeritsky Alexey Ozeritskiy
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: