Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1974

FairScheduler can preempt the same task many times

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0, 0.21.1, 0.22.0, 0.23.0
    • Fix Version/s: 0.22.0
    • Component/s: contrib/fair-share
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In FairScheduler.preemptTasks(), tasks are collected from JobInProgress.runningMapCache.
      But tasks repeat multiple times in JobInProgress.runningMapCache (on rack, node and cluster).
      This makes FairScheduler preempt the same task many times.

        Activity

          People

          • Assignee:
            Scott Chen
            Reporter:
            Scott Chen
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development