Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10302

Support custom packing algorithm for FairScheduler

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      The FairScheduler class allocates containers to nodes based on the node with the most available memory[0]. Create the ability to instead configure a custom packing algorithm with different logic. For instance for effective auto scaling, a bin packing algorithm might be a better choice.

      0 - https://github.com/apache/hadoop/blob/56b7571131b0af03b32bf1c5673c32634652df21/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java#L1034-L1043

        Attachments

        1. YARN-10302-trunk.001.patch
          6 kB
          William W. Graham Jr

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              billgraham William W. Graham Jr
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: