Uploaded image for project: 'Kudu'
  1. Kudu
  2. KUDU-2187

Don't hold threadpool lock when creating additional workers

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.6.0
    • Fix Version/s: 1.6.0
    • Component/s: perf, util
    • Labels:
      None
    • Target Version/s:

      Description

      I've noticed in a lot of clusters that creating new threads often takes a relatively long time, for whatever reason. Currently we create new threads while holding the threadpool's lock, which means that, even if other existing worker threads finish their current work items and are ready to handle newly enqueued work, everything is frozen while the thread is being created. This creates potentially long stalls resulting in increased queue time at the high percentiles.

        Attachments

          Activity

            People

            • Assignee:
              tlipcon Todd Lipcon
              Reporter:
              tlipcon Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: