Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5567 [Umbrella] Stabilize MR framework w.r.t ResourceManager restart
  3. MAPREDUCE-5466

Historyserver does not refresh the result of restarted jobs after RM restart

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.1.1-beta
    • Component/s: None
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Restart RM when sort job is running and verify that the job passes successfully after RM restarts.

      Once the job finishes successfully, run job status command for sort job. It shows "Job state =FAILED". Job history server does not update the result for the job which restarted after RM restart.

      hadoop job -status job_1375923346354_0003
      13/08/08 01:24:13 INFO mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=SUCCEEDED. Redirecting to job history server

      Job: job_1375923346354_0003
      Job File: hdfs://host1:port1/history/done/2013/08/08/000000/job_1375923346354_0003_conf.xml
      Job Tracking URL : http://historyserver:port2/jobhistory/job/job_1375923346354_0003
      Uber job : false
      Number of maps: 80
      Number of reduces: 1
      map() completion: 0.0
      reduce() completion: 0.0
      Job state: FAILED
      retired: false
      reason for failure: There are no failed tasks for the job. Job is failed due to some other reason and reason can be found in the logs.
      Counters not available. Job is retired.

        Attachments

        1. MAPREDUCE-5466.patch
          14 kB
          Jian He
        2. MAPREDUCE-5466.3.patch
          22 kB
          Jian He
        3. MAPREDUCE-5466.2.patch
          22 kB
          Jian He
        4. MAPREDUCE-5466.1.patch
          23 kB
          Jian He

          Issue Links

            Activity

              People

              • Assignee:
                jianhe Jian He
                Reporter:
                yeshavora Yesha Vora
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: