Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-4623

Running tasks are not maintained by JobInProgress if speculation is off

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.20.0
    • None
    • None
    • Reviewed

    Description

      JobInProgress doesnt maintain any structure for running tasks if speculation is turned off. getRunningMapCache() in JobInProgress exposes the running map cache. This api returns an empty Map if speculation turned off.

      Usage :
      CapicityScheduler requires a list of running tasks for both speculated and non-speculated jobs. See HADOOP-4558 to see how this issue affects CapacityScheduler.

      Attachments

        1. HADOOP-4623-v1.1.patch
          50 kB
          Amar Kamat
        2. HADOOP-4623-v1.2.patch
          58 kB
          Amar Kamat
        3. HADOOP-4623-v1.3.patch
          58 kB
          Amar Kamat
        4. HADOOP-4623-v1.4.patch
          59 kB
          Amar Kamat

        Issue Links

          Activity

            People

              amar_kamat Amar Kamat
              amar_kamat Amar Kamat
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: