Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1974

FairScheduler can preempt the same task many times

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0, 0.21.1, 0.22.0, 0.23.0
    • Fix Version/s: 0.22.0
    • Component/s: contrib/fair-share
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In FairScheduler.preemptTasks(), tasks are collected from JobInProgress.runningMapCache.
      But tasks repeat multiple times in JobInProgress.runningMapCache (on rack, node and cluster).
      This makes FairScheduler preempt the same task many times.

        Activity

        Scott Chen created issue -
        Scott Chen made changes -
        Field Original Value New Value
        Affects Version/s 0.20.1 [ 12314047 ]
        Component/s contrib/fair-share [ 12312901 ]
        Scott Chen made changes -
        Fix Version/s 0.22.0 [ 12314184 ]
        Affects Version/s 0.21.0 [ 12314045 ]
        Affects Version/s 0.22.0 [ 12314184 ]
        Affects Version/s 0.20.1 [ 12314047 ]
        Scott Chen made changes -
        Attachment MAPREDUCE-1974.txt [ 12450748 ]
        Scott Chen made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Scott Chen made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Scott Chen made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 0.21.1 [ 12315272 ]
        Affects Version/s 0.23.0 [ 12315570 ]
        Fix Version/s 0.21.1 [ 12315272 ]
        Fix Version/s 0.23.0 [ 12315570 ]
        Nigel Daley made changes -
        Fix Version/s 0.22.0 [ 12314184 ]
        Fix Version/s 0.21.1 [ 12315272 ]
        Fix Version/s 0.23.0 [ 12315570 ]
        Konstantin Shvachko made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.22.0 [ 12314184 ]
        Resolution Fixed [ 1 ]
        Konstantin Shvachko made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Scott Chen
            Reporter:
            Scott Chen
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development