Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-546

Task tracker doesnt generate job.xml in jobcache for some tasks ( possibly for only rescheduled tasks)

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 0.6.2
    • Fix Version/s: 0.10.0
    • Component/s: None
    • Labels:
      None

      Description

      For many of the rescheduled tasks task tracker doesn't generate job.xml causing the task to fail. The exception appears in Job tracker logs and not in task tracker's logs.

      possibly related to Hadoop-543

      2006-09-19 01:10:37,064 INFO org.apache.hadoop.mapred.TaskInProgress: Error from task_0001_m_022869_3: java.io.FileNotFoundException: .../hadoop/mapred/local/taskTracker/jobcache/job_0001/task_0001_m_022869_3/job.xml (No such file or directory)
      at java.io.FileOutputStream.open(Native Method)
      at java.io.FileOutputStream.<init>(FileOutputStream.java:179)
      at java.io.FileOutputStream.<init>(FileOutputStream.java:131)
      at org.apache.hadoop.fs.LocalFileSystem$LocalFSFileOutputStream.<init>(LocalFileSystem.java:133)
      at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:172)
      at org.apache.hadoop.fs.LocalFileSystem.createRaw(LocalFileSystem.java:180)
      at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:56)
      at org.apache.hadoop.fs.FSDataOutputStream$Summer.<init>(FSDataOutputStream.java:45)
      at org.apache.hadoop.fs.FSDataOutputStream.<init>(FSDataOutputStream.java:146)
      at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:270)
      at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:177)
      at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:810)
      at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:858)
      at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:282)
      at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:275)
      at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:669)
      at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:486)
      at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:689)
      at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1290)

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                acmurthy Arun C Murthy
                Reporter:
                sanjay.dahiya Sanjay Dahiya
              • Votes:
                1 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: