Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5541

Improved algorithm for whether need speculative task

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • 1.2.1
    • 1.2.2
    • mrv1
    • None

    Description

      Most of time, tasks won't start running at same time.
      In this case hasSpeculativeTask in TaskInProgress not working very well.
      Some times, some tasks just start running, and scheduler already decide it need speculative task to run.
      And this waste a lot of resource.

      Attachments

        1. MAPREDUCE-5541-branch-1.2.patch
          4 kB
          yunjiong zhao
        2. MAPREDUCE-5541-branch-1.2.patch
          4 kB
          yunjiong zhao

        Activity

          People

            zhaoyunjiong yunjiong zhao
            zhaoyunjiong yunjiong zhao
            Votes:
            1 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: