Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1184

mapred.reduce.slowstart.completed.maps is too low by default

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.20.1, 0.20.2
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      By default, this value is set to 5%. I believe for most real world situations the code isn't efficient enough to be set this low. This should be higher, probably around the 50% mark, especially given the predominance of non-FIFO schedulers.

        Issue Links

          Activity

          Allen Wittenauer created issue -
          Allen Wittenauer made changes -
          Field Original Value New Value
          Summary mapred.reduce.slowstart.completed.maps is too high by default mapred.reduce.slowstart.completed.maps is too low by default
          Allen Wittenauer made changes -
          Affects Version/s 0.20.2 [ 12314205 ]
          Affects Version/s 0.20.1 [ 12314047 ]
          Todd Lipcon made changes -
          Link This issue is related to MAPREDUCE-1463 [ MAPREDUCE-1463 ]
          Allen Wittenauer made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Resolution Won't Fix [ 2 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Allen Wittenauer
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development