Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-897

CapacityScheduler wrongly sorted queues

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 2.0.4-alpha
    • Fix Version/s: 2.1.0-beta
    • Component/s: capacityscheduler
    • Labels:
      None

      Description

      The childQueues of a ParentQueue are stored in a TreeSet where UsedCapacity defines the sort order. This ensures the queue with least UsedCapacity to receive resources next. On containerAssignment we correctly update the order, but we miss to do so on container completions. This corrupts the TreeSet structure, and under-capacity queues might starve for resources.

        Attachments

        1. YARN-897-4.patch
          31 kB
          Djellel Eddine Difallah
        2. YARN-897-3.patch
          31 kB
          Djellel Eddine Difallah
        3. YARN-897-2.patch
          4 kB
          Djellel Eddine Difallah
        4. YARN-897-1.patch
          4 kB
          Djellel Eddine Difallah
        5. YARN-897-08152013-br-0.23.patch
          13 kB
          Mit Desai
        6. TestBugParentQueue.java
          16 kB
          Djellel Eddine Difallah

          Activity

            People

            • Assignee:
              dedcode Djellel Eddine Difallah
              Reporter:
              dedcode Djellel Eddine Difallah
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: