Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-10302

Support custom packing algorithm for FairScheduler

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      The FairScheduler class allocates containers to nodes based on the node with the most available memory[0]. Create the ability to instead configure a custom packing algorithm with different logic. For instance for effective auto scaling, a bin packing algorithm might be a better choice.

      0 - https://github.com/apache/hadoop/blob/56b7571131b0af03b32bf1c5673c32634652df21/hadoop-yarn-project/hadoop-yarn/hadoop-yarn-server/hadoop-yarn-server-resourcemanager/src/main/java/org/apache/hadoop/yarn/server/resourcemanager/scheduler/fair/FairScheduler.java#L1034-L1043

      Attachments

        1. YARN-10302-trunk.001.patch
          6 kB
          William W. Graham Jr

        Activity

          People

            Unassigned Unassigned
            billgraham William W. Graham Jr
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: