[HADOOP-1234] map tasks fail because they do not find application in file cache

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.12.1
• Fix Version/s: 0.14.0
• Assignee: Arun Murthy
• Reporter: Christian Kunz
• Created: 09/Apr/07 21:00
• Updated: 08/Jul/09 16:52
• Resolved: 15/Jun/07 21:34

Description

Using C++ map-reduce interface, a lot of tasks fail because they do not find the application in the file cache.
Might be a race condition between multiple tasks on the same node.

java.io.IOException: Cannot run program "<path>/mapred/local/taskTracker/archive/<namenodehost>/<path>/<application>": java.io.IOException: error=2, No such file or directory
at java.lang.ProcessBuilder.start(ProcessBuilder.java:459)
at org.apache.hadoop.mapred.pipes.Application.runClient(Application.java:131)
at org.apache.hadoop.mapred.pipes.Application.(Application.java:59)
at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:44)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:176)
at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1459)
Caused by: java.io.IOException: java.io.IOException: error=2, No such file or directory
at java.lang.UNIXProcess.(UNIXProcess.java:148)
at java.lang.ProcessImpl.start(ProcessImpl.java:65)
at java.lang.ProcessBuilder.start(ProcessBuilder.java:452)
... 5 more