Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2162

add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

    Details

    • Hadoop Flags:
      Reviewed

      Description

      minResources and maxResources in fair scheduler configs are expressed in terms of absolute numbers X mb, Y vcores.
      As a result, when we expand or shrink our hadoop cluster, we need to recalculate and change minResources/maxResources accordingly, which is pretty inconvenient.
      We can circumvent this problem if we can optionally configure these properties in terms of percentage of cluster capacity.

        Attachments

        1. YARN-2162.branch-2.010.patch
          54 kB
          Yufei Gu
        2. YARN-2162.branch-3.0.009.patch
          54 kB
          Yufei Gu
        3. YARN-2162.008.patch
          54 kB
          Yufei Gu
        4. test-400nm-200app-2k_NODE_UPDATE.timecost.svg
          20 kB
          Yufei Gu
        5. YARN-2162.007.patch
          54 kB
          Yufei Gu
        6. YARN-2162.006.patch
          53 kB
          Yufei Gu
        7. YARN-2162.005.patch
          48 kB
          Yufei Gu
        8. YARN-2162.004.patch
          48 kB
          Yufei Gu
        9. YARN-2162.003.patch
          48 kB
          Yufei Gu
        10. YARN-2162.002.patch
          49 kB
          Yufei Gu
        11. YARN-2162.001.patch
          47 kB
          Yufei Gu

          Issue Links

            Activity

              People

              • Assignee:
                yufeigu Yufei Gu
                Reporter:
                ashwinshankar77 Ashwin Shankar
              • Votes:
                0 Vote for this issue
                Watchers:
                17 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: