Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-2162

add ability in Fair Scheduler to optionally configure maxResources in terms of percentage

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      minResources and maxResources in fair scheduler configs are expressed in terms of absolute numbers X mb, Y vcores.
      As a result, when we expand or shrink our hadoop cluster, we need to recalculate and change minResources/maxResources accordingly, which is pretty inconvenient.
      We can circumvent this problem if we can optionally configure these properties in terms of percentage of cluster capacity.

      Attachments

        1. test-400nm-200app-2k_NODE_UPDATE.timecost.svg
          20 kB
          Yufei Gu
        2. YARN-2162.001.patch
          47 kB
          Yufei Gu
        3. YARN-2162.002.patch
          49 kB
          Yufei Gu
        4. YARN-2162.003.patch
          48 kB
          Yufei Gu
        5. YARN-2162.004.patch
          48 kB
          Yufei Gu
        6. YARN-2162.005.patch
          48 kB
          Yufei Gu
        7. YARN-2162.006.patch
          53 kB
          Yufei Gu
        8. YARN-2162.007.patch
          54 kB
          Yufei Gu
        9. YARN-2162.008.patch
          54 kB
          Yufei Gu
        10. YARN-2162.branch-2.010.patch
          54 kB
          Yufei Gu
        11. YARN-2162.branch-3.0.009.patch
          54 kB
          Yufei Gu

        Issue Links

          links to

          Web Link GitHub Pull Request #261

          Activity

            People

              yufeigu Yufei Gu
              ashwinshankar77 Ashwin Shankar
              Votes:
              0 Vote for this issue
              Watchers:
              17 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: