[HADOOP-546] Task tracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks)

• Type: Bug
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Affects Version/s: 0.6.2
• Fix Version/s: 0.10.0
• Assignee: Arun Murthy
• Reporter: Sanjay Dahiya
• Created: 19/Sep/06 10:37
• Updated: 08/Jul/09 16:51
• Resolved: 12/Dec/06 06:04

Description

For many of the rescheduled tasks task tracker doesn't generate job.xml causing the task to fail. The exception appears in Job tracker logs and not in task tracker's logs.

possibly related to Hadoop-543

2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0001_m_022869_3: java.io.FileNotFoundException: .../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml (No such file or directory)
at java.io.FileOutputStream.open(Native Method)
at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
at org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
at org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)

Issue Links

• duplicates: HADOOP-737 TaskTracker's job cleanup loop should check for finished job before deleting local directories