Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • capacity scheduler
    • None
    • Reviewed

    Description

      To allow the possibility to flexibly create queues in Capacity Scheduler a weight mode should be introduced. The existing {{capacity }}property should be used with a different syntax, i.e:

      root.users.capacity = (1.0) or ~1.0 or ^1.0 or @1.0

      root.users.capacity = 1.0w

      root.users.capacity = w:1.0

      Weight support should not impact the existing functionality.

       

      The new functionality should:

      • accept and validate the new weight values
      • enforce a singular mode on the whole queue tree
      • (re)calculate the relative (percentage-based) capacities based on the weights during launch and every time the queue structure changes

      Attachments

        1. YARN-10504.ver-3.patch
          86 kB
          Wangda Tan
        2. YARN-10504.ver-2.patch
          85 kB
          Wangda Tan
        3. YARN-10504.ver-1.patch
          110 kB
          Wangda Tan
        4. YARN-10504.011.patch
          132 kB
          Benjamin Teke
        5. YARN-10504.010.patch
          132 kB
          Wangda Tan
        6. YARN-10504.009.patch
          132 kB
          Wangda Tan
        7. YARN-10504.008.patch
          134 kB
          Wangda Tan
        8. YARN-10504.007.patch
          123 kB
          Benjamin Teke
        9. YARN-10504.006.patch
          123 kB
          Wangda Tan
        10. YARN-10504.005.patch
          95 kB
          Benjamin Teke
        11. YARN-10504.004.patch
          104 kB
          Qi Zhu
        12. YARN-10504.003.patch
          105 kB
          Qi Zhu
        13. YARN-10504.002.patch
          94 kB
          Andras Gyori
        14. YARN-10504.001.patch
          17 kB
          Qi Zhu

        Issue Links

          Activity

            People

              bteke Benjamin Teke
              bteke Benjamin Teke
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: