Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-897

CapacityScheduler wrongly sorted queues

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 2.0.4-alpha
    • 2.1.0-beta
    • capacityscheduler
    • None

    Description

      The childQueues of a ParentQueue are stored in a TreeSet where UsedCapacity defines the sort order. This ensures the queue with least UsedCapacity to receive resources next. On containerAssignment we correctly update the order, but we miss to do so on container completions. This corrupts the TreeSet structure, and under-capacity queues might starve for resources.

      Attachments

        1. TestBugParentQueue.java
          16 kB
          Djellel Eddine Difallah
        2. YARN-897-2.patch
          4 kB
          Djellel Eddine Difallah
        3. YARN-897-1.patch
          4 kB
          Djellel Eddine Difallah
        4. YARN-897-3.patch
          31 kB
          Djellel Eddine Difallah
        5. YARN-897-4.patch
          31 kB
          Djellel Eddine Difallah
        6. YARN-897-08152013-br-0.23.patch
          13 kB
          Mit Desai

        Activity

          People

            dedcode Djellel Eddine Difallah
            dedcode Djellel Eddine Difallah
            Votes:
            0 Vote for this issue
            Watchers:
            9 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: