Details

    • Type: Bug Bug
    • Status: Patch Available
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.21.0
    • Fix Version/s: None
    • Component/s: contrib/fair-share
    • Labels:

      Description

      hi, there is no limitation about min share of all pools with cluster total shares. User can define arbitrary amount of min share for each pool. It has such description in <fair scheduler design document>, but no regular code.
      It may critical for slot distribution. One pool can hold all cluster slots to meet it's min share that greater than cluster total slots very much.
      If that case has happened, we should scaled down proportionally.

      1. MAPREDUCE-2393.patch
        0.9 kB
        Kenji Kikushima

        Activity

        Hide
        Kenji Kikushima added a comment -

        FairScheduler uses min share directly, nevertheless total min share exceeds total slots.
        I made a patch for this issue to scale down min share by w2sRatio.

        Show
        Kenji Kikushima added a comment - FairScheduler uses min share directly, nevertheless total min share exceeds total slots. I made a patch for this issue to scale down min share by w2sRatio.
        Hide
        Mostafa Elhemali added a comment -

        Can you please add a test for this case?

        Show
        Mostafa Elhemali added a comment - Can you please add a test for this case?

          People

          • Assignee:
            Unassigned
            Reporter:
            Denny Ye
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:

              Development