Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1198

Alternatively schedule different types of tasks in fair share scheduler

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.21.0
    • Component/s: contrib/fair-share
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Matei has mentioned in MAPREDUCE-961 that the current scheduler will first try to launch map tasks until canLaunthTask() returns false then look for reduce tasks. This might starve reduce task. He also mention that alternatively schedule different types of tasks can solve this problem.

        Attachments

        1. MAPREDUCE-1198-v1.patch
          20 kB
          Scott Chen
        2. MAPREDUCE-1198-v2.patch
          29 kB
          Scott Chen
        3. MAPREDUCE-1198-v3.patch
          29 kB
          Scott Chen
        4. MAPREDUCE-1198-v4.patch
          29 kB
          Scott Chen
        5. MAPREDUCE-1198-v5.patch
          29 kB
          Scott Chen

          Activity

            People

            • Assignee:
              schen Scott Chen
              Reporter:
              schen Scott Chen
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: