[HADOOP-4296] Spasm of JobClient failures on successful jobs every once in a while

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.17.1
• Fix Version/s: 0.19.0
• Hadoop Flags: Reviewed
• Assignee: Dhruba Borthakur
• Reporter: Joydeep Sen Sarma
• Created: 27/Sep/08 17:13
• Updated: 08/Jul/09 16:53
• Resolved: 21/Oct/08 06:19

Description

At very busy times - we get a wave of job client failures all at the same time. the failures come when the job is about to complete. when we look at the job history files - the jobs are actually complete. Here's the stack:

08/09/27 02:18:00 INFO mapred.JobClient: map 100% reduce 98%
08/09/27 02:18:41 INFO mapred.JobClient: map 100% reduce 99%
java.lang.NullPointerException
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:993)
at com.facebook.hive.common.columnSetLoader.main(columnSetLoader.java:535)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:597)
at org.apache.hadoop.util.RunJar.main(RunJar.java:155)