Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.21.0
    • Fix Version/s: None
    • Component/s: contrib/fair-share
    • Labels:

      Description

      hi, there is no limitation about min share of all pools with cluster total shares. User can define arbitrary amount of min share for each pool. It has such description in <fair scheduler design document>, but no regular code.
      It may critical for slot distribution. One pool can hold all cluster slots to meet it's min share that greater than cluster total slots very much.
      If that case has happened, we should scaled down proportionally.

      1. MAPREDUCE-2393.patch
        0.9 kB
        Kenji Kikushima

        Activity

        Denny Ye created issue -
        Hide
        Kenji Kikushima added a comment -

        FairScheduler uses min share directly, nevertheless total min share exceeds total slots.
        I made a patch for this issue to scale down min share by w2sRatio.

        Show
        Kenji Kikushima added a comment - FairScheduler uses min share directly, nevertheless total min share exceeds total slots. I made a patch for this issue to scale down min share by w2sRatio.
        Kenji Kikushima made changes -
        Field Original Value New Value
        Attachment MAPREDUCE-2393.patch [ 12490803 ]
        Kenji Kikushima made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        Mostafa Elhemali added a comment -

        Can you please add a test for this case?

        Show
        Mostafa Elhemali added a comment - Can you please add a test for this case?
        Hide
        Hadoop QA added a comment -



        -1 overall



        Vote Subsystem Runtime Comment
        -1 patch 0m 0s The patch command could not apply the patch during dryrun.



        Subsystem Report/Notes
        Patch URL http://issues.apache.org/jira/secure/attachment/12490803/MAPREDUCE-2393.patch
        Optional Tests javadoc javac unit findbugs checkstyle
        git revision trunk / f1a152c
        Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5503/console

        This message was automatically generated.

        Show
        Hadoop QA added a comment - -1 overall Vote Subsystem Runtime Comment -1 patch 0m 0s The patch command could not apply the patch during dryrun. Subsystem Report/Notes Patch URL http://issues.apache.org/jira/secure/attachment/12490803/MAPREDUCE-2393.patch Optional Tests javadoc javac unit findbugs checkstyle git revision trunk / f1a152c Console output https://builds.apache.org/job/PreCommit-MAPREDUCE-Build/5503/console This message was automatically generated.
        Allen Wittenauer made changes -
        Labels fair scheduler BB2015-05-TBR fair scheduler
        Hide
        Mohammad Shahid Khan added a comment -

        MRV2 architecture is now changed and as per current scenario looks like invalid issue.

        Show
        Mohammad Shahid Khan added a comment - MRV2 architecture is now changed and as per current scenario looks like invalid issue.
        Mohammad Shahid Khan made changes -
        Labels BB2015-05-TBR fair scheduler BB2015-05-RFC
        Hide
        Mohammad Shahid Khan added a comment -

        as per current scenario seems like invalid.
        Please reopen if issue yet exist.

        Show
        Mohammad Shahid Khan added a comment - as per current scenario seems like invalid. Please reopen if issue yet exist.
        Mohammad Shahid Khan made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        154d 9h 57m 1 Kenji Kikushima 18/Aug/11 16:45
        Patch Available Patch Available Resolved Resolved
        1358d 18h 55m 1 Mohammad Shahid Khan 08/May/15 11:41

          People

          • Assignee:
            Unassigned
            Reporter:
            Denny Ye
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development