Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-4742 [Umbrella] Enhancements to Distributed Scheduling
  3. YARN-5350

Distributed Scheduling: Ensure sort order of allocatable nodes returned by the RM is not lost

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.9.0, 3.0.0-alpha1
    • None
    • None

    Description

      The LocalScheduler receives an ordered list of nodes from the RM with each allocate call. This list, which is used by the LocalScheduler to allocate OPPORTUNISTIC containers, is sorted on the Nodes free capacity (queue length / wait time).

      Unfortunately, the LocalScheduler stores this list in a HashMap thereby losing the sort order.

      The trivial fix would be to replace the HashMap with a LinkedHashMap which retains the insertion order.

      Attachments

        1. YARN-5350.001.patch
          13 kB
          Arun Suresh
        2. YARN-5350.002.patch
          13 kB
          Arun Suresh
        3. YARN-5350.003.patch
          15 kB
          Arun Suresh

        Activity

          People

            asuresh Arun Suresh
            asuresh Arun Suresh
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: