[MAPREDUCE-413] job.jar, job.xml not deleted when JobClient submitJob method fail with exception

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Cannot Reproduce
• Labels: newbie
• Assignee: Unassigned
• Reporter: Koji Noguchi
• Created: 13/Jan/07 01:46
• Updated: 12/May/15 09:47
• Resolved: 12/May/15 09:47

Description

If mapred.system.dir is set to /hadoop/mapred/system,

$ hadoop dfs -lsr /hadoop
/hadoop/mapred <dir>
/hadoop/mapred/system <dir>
$

$ hadoop jar hadoop-examples.jar wordcount invaliddirectoryname output
org.apache.hadoop.mapred.InvalidInputException: Input path doesnt exist : /user/_____/invaliddirectoryname
at org.apache.hadoop.mapred.InputFormatBase.validateInput(InputFormatBase.java:138)
at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:316)
at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:371)
at org.apache.hadoop.examples.WordCount.main(WordCount.java:143)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:71)
at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:143)
at org.apache.hadoop.examples.ExampleDriver.main(ExampleDriver.java:40)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:585)
at org.apache.hadoop.util.RunJar.main(RunJar.java:155)

$ hadoop dfs -lsr /hadoop
/hadoop/mapred <dir>
/hadoop/mapred/system <dir>
/hadoop/mapred/system/submit_gpw022 <dir>
/hadoop/mapred/system/submit_gpw022/job.jar <r 10> 19397

$ ls -l hadoop-examples.jar
rw-rr- 1 _____ _____ 19397 hadoop-examples.jar