Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4788

Set mapred.fairscheduler.assignmultiple to true by default

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Trivial
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: None
    • Labels:
      None

      Description

      Pretty much all users of the fair scheduler are using the "assignmultiple" feature which lets it launch reduce tasks at the same time as map tasks (on the same heartbeats), leading to reduces starting faster. This is also going to happen in Hadoop by default in HADOOP-3136. So we should set it to true by default and perhaps even remove the config parameter.

        Attachments

          Activity

            People

            • Assignee:
              matei Matei Zaharia
              Reporter:
              matei Matei Zaharia
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: