Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5541

Improved algorithm for whether need speculative task

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 1.2.1
    • Fix Version/s: 1.2.2
    • Component/s: mrv1
    • Labels:
      None

      Description

      Most of time, tasks won't start running at same time.
      In this case hasSpeculativeTask in TaskInProgress not working very well.
      Some times, some tasks just start running, and scheduler already decide it need speculative task to run.
      And this waste a lot of resource.

        Attachments

        1. MAPREDUCE-5541-branch-1.2.patch
          4 kB
          yunjiong zhao
        2. MAPREDUCE-5541-branch-1.2.patch
          4 kB
          yunjiong zhao

          Activity

            People

            • Assignee:
              zhaoyunjiong yunjiong zhao
              Reporter:
              zhaoyunjiong yunjiong zhao
            • Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: