[MAPREDUCE-7179] Job status not available when job finished

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.6.0, 2.7.0, 2.8.0, 2.9.0, 3.0.0
• Assignee: Zhaohui Xin
• Reporter: Zhaohui Xin
• Created: 31/Jan/19 13:06
• Updated: 01/Feb/19 03:38

Description

Job status not available when job finished. This is because JobHistory Server may be unavailable momently or not parse this job history file temporarily.

18/04/09 17:04:11 INFO mapred.ClientServiceDelegate: Application state is completed. FinalApplicationStatus=FAILED. Redirecting to job history server
18/04/09 17:04:29 ERROR streaming.StreamJob: Error Launching job : Job status not available 
java.io.IOException: Job status not available 
	at org.apache.hadoop.mapreduce.Job.updateStatus(Job.java:333)
	at org.apache.hadoop.mapreduce.Job.isComplete(Job.java:620)
	at org.apache.hadoop.mapreduce.Job.monitorAndPrintJob(Job.java:1366)
	at org.apache.hadoop.mapred.JobClient$NetworkedJob.monitorAndPrintJob(JobClient.java:408)
	at org.apache.hadoop.mapred.JobClient.monitorAndPrintJob(JobClient.java:857)
	at org.apache.hadoop.streaming.StreamJob.submitAndMonitorJob(StreamJob.java:1018)
	at org.apache.hadoop.streaming.StreamJob.run(StreamJob.java:135)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
	at org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:58)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.apache.hadoop.util.RunJar.run(RunJar.java:221)
	at org.apache.hadoop.util.RunJar.main(RunJar.java:136)
Streaming Command Failed!

 

Issue Links

• relates to: MAPREDUCE-6762 ControlledJob#toString failed with NPE when job status is not successfully updated
• relates to: MAPREDUCE-6852 Job#updateStatus() failed with NPE due to race condition
• relates to: MAPREDUCE-6566 Add retry support to mapreduce CLI tool