Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4788

Set mapred.fairscheduler.assignmultiple to true by default

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Trivial
    • Resolution: Fixed
    • None
    • 0.21.0
    • None
    • None

    Description

      Pretty much all users of the fair scheduler are using the "assignmultiple" feature which lets it launch reduce tasks at the same time as map tasks (on the same heartbeats), leading to reduces starting faster. This is also going to happen in Hadoop by default in HADOOP-3136. So we should set it to true by default and perhaps even remove the config parameter.

      Attachments

        1. hadoop-4788-v0.patch
          1 kB
          Matei Alexandru Zaharia

        Activity

          People

            matei Matei Alexandru Zaharia
            matei Matei Alexandru Zaharia
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: