Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1198

Alternatively schedule different types of tasks in fair share scheduler

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.22.0
    • 0.21.0
    • contrib/fair-share
    • None
    • Reviewed

    Description

      Matei has mentioned in MAPREDUCE-961 that the current scheduler will first try to launch map tasks until canLaunthTask() returns false then look for reduce tasks. This might starve reduce task. He also mention that alternatively schedule different types of tasks can solve this problem.

      Attachments

        1. MAPREDUCE-1198-v5.patch
          29 kB
          Scott Chen
        2. MAPREDUCE-1198-v4.patch
          29 kB
          Scott Chen
        3. MAPREDUCE-1198-v3.patch
          29 kB
          Scott Chen
        4. MAPREDUCE-1198-v2.patch
          29 kB
          Scott Chen
        5. MAPREDUCE-1198-v1.patch
          20 kB
          Scott Chen

        Activity

          People

            schen Scott Chen
            schen Scott Chen
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: