Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4623

Running tasks are not maintained by JobInProgress if speculation is off

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      JobInProgress doesnt maintain any structure for running tasks if speculation is turned off. getRunningMapCache() in JobInProgress exposes the running map cache. This api returns an empty Map if speculation turned off.

      Usage :
      CapicityScheduler requires a list of running tasks for both speculated and non-speculated jobs. See HADOOP-4558 to see how this issue affects CapacityScheduler.

        Attachments

        1. HADOOP-4623-v1.1.patch
          50 kB
          Amar Kamat
        2. HADOOP-4623-v1.2.patch
          58 kB
          Amar Kamat
        3. HADOOP-4623-v1.3.patch
          58 kB
          Amar Kamat
        4. HADOOP-4623-v1.4.patch
          59 kB
          Amar Kamat

          Issue Links

            Activity

              People

              • Assignee:
                amar_kamat Amar Kamat
                Reporter:
                amar_kamat Amar Kamat
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: