Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4742 [Umbrella] Enhancements to Distributed Scheduling
  3. YARN-5350

Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.9.0, 3.0.0-alpha1
    • Component/s: None
    • Labels:
      None

      Description

      The LocalScheduler receives an ordered list of nodes from the RM with each allocate call. This list, which is used by the LocalScheduler to allocate OPPORTUNISTIC containers, is sorted on the Nodes free capacity (queue length / wait time).

      Unfortunately, the LocalScheduler stores this list in a HashMap thereby losing the sort order.

      The trivial fix would be to replace the HashMap with a LinkedHashMap which retains the insertion order.

        Attachments

        1. YARN-5350.001.patch
          13 kB
          Arun Suresh
        2. YARN-5350.002.patch
          13 kB
          Arun Suresh
        3. YARN-5350.003.patch
          15 kB
          Arun Suresh

          Activity

            People

            • Assignee:
              asuresh Arun Suresh
              Reporter:
              asuresh Arun Suresh
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: