Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-3251

Fix CapacityScheduler deadlock when computing absolute max avail capacity (short term fix for 2.6.1)

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 2.6.0
    • 2.6.1
    • None
    • Reviewed

    Description

      The ResourceManager can deadlock in the CapacityScheduler when computing the absolute max available capacity for user limits and headroom.

      Attachments

        1. YARN-3251.1.patch
          7 kB
          Craig Welch
        2. YARN-3251.2-6-0.2.patch
          6 kB
          Craig Welch
        3. YARN-3251.2-6-0.3.patch
          3 kB
          Craig Welch
        4. YARN-3251.2-6-0.4.patch
          3 kB
          Craig Welch
        5. YARN-3251.2.patch
          4 kB
          Craig Welch

        Issue Links

          is broken by

          Sub-task - The sub-task of the issue YARN-2008 CapacityScheduler may report incorrect queueMaxCap if there is hierarchy queue structure

          • Major - Major loss of function.
          • Closed
          is related to

          Sub-task - The sub-task of the issue YARN-3265 CapacityScheduler deadlock when computing absolute max avail capacity (fix for trunk/branch-2)

          • Blocker - Blocks development and/or testing work, production could not run
          • Closed
          relates to

          Bug - A problem which impairs or prevents the functions of the product. YARN-3243 CapacityScheduler should pass headroom from parent to children to make sure ParentQueue obey its capacity limits.

          • Major - Major loss of function.
          • Closed

          Activity

            People

              cwelch Craig Welch
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: