Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1057

IOException: job.xml already exists

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Cannot Reproduce
    • 0.11.2
    • None
    • None
    • None

    Description

      Running TestMiniMRLocalFS on Linux, I saw this exception during the 2nd job that it runs:

      [junit] 2007-02-28 21:09:50,076 INFO mapred.JobInProgress (JobInProgress.java:findNewTask(573)) - Choosing normal task tip_0002_r_000000
      [junit] 2007-02-28 21:09:50,079 INFO mapred.JobTracker (JobTracker.java:createTaskEntry(709)) - Adding task 'task_0002_r_000000_0' to tip tip_0002_r_000000, for tracker 'tracker_foo.com:60042'
      [junit] 2007-02-28 21:09:50,080 INFO mapred.TaskTracker (TaskTracker.java:startNewTask(849)) - LaunchTaskAction: task_0002_r_000000_0
      [junit] 2007-02-28 21:09:50,089 WARN mapred.TaskTracker (TaskTracker.java:startNewTask(866)) - Error initializing task_0002_r_000000_0:
      [junit] java.io.IOException: Target /foo/trunk/build/test/mapred/local/60044_0/taskTracker/jobcache/job_0002/job.xml already exists
      [junit] at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:226)
      [junit] at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:70)
      [junit] at org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:55)
      [junit] at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:766)
      [junit] at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:351)
      [junit] at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:862)
      [junit] at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:530)
      [junit] at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:898)
      [junit] at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:130)
      [junit] at java.lang.Thread.run(Thread.java:595)

      [junit] 2007-02-28 21:09:51,115 INFO mapred.TaskTracker (TaskTracker.java:reportProgress(1056)) - task_0002_m_000000_0 1.0% file:/foo/trunk/build/test/data/wc/input/part-0:0+47
      [junit] 2007-02-28 21:09:51,117 INFO mapred.TaskTracker (TaskTracker.java:reportDone(1106)) - Task task_0002_m_000000_0 is done.
      [junit] 2007-02-28 21:09:51,203 INFO mapred.JobInProgress (JobInProgress.java:completedTask(616)) - Task 'task_0002_m_000000_0' has completed tip_0002_m_000000 successfully.
      [junit] 2007-02-28 21:09:51,203 INFO mapred.TaskInProgress (TaskInProgress.java:completedTask(411)) - Task 'task_0002_m_000000_0' has completed.
      [junit] 2007-02-28 21:09:51,847 INFO mapred.TaskInProgress (TaskInProgress.java:updateStatus(328)) - Error from task_0002_r_000000_0: Error initializing task_0002_r_000000_0:
      [junit] java.io.IOException: Target /foo/trunk/build/test/mapred/local/60044_0/taskTracker/jobcache/job_0002/job.xml already exists
      [junit] at org.apache.hadoop.fs.FileUtil.checkDest(FileUtil.java:226)
      [junit] at org.apache.hadoop.fs.FileUtil.copy(FileUtil.java:70)
      [junit] at org.apache.hadoop.fs.LocalFileSystem.copyToLocalFile(LocalFileSystem.java:55)
      [junit] at org.apache.hadoop.fs.FileSystem.copyToLocalFile(FileSystem.java:766)
      [junit] at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:351)
      [junit] at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:862)
      [junit] at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:530)
      [junit] at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:898)
      [junit] at org.apache.hadoop.mapred.MiniMRCluster$TaskTrackerRunner.run(MiniMRCluster.java:130)
      [junit] at java.lang.Thread.run(Thread.java:595)

      [junit] 2007-02-28 21:09:51,848 INFO mapred.TaskInProgress (TaskInProgress.java:failedSubTask(380)) - Task 'task_0002_r_000000_0' has been lost.

      Attachments

        Activity

          People

            Unassigned Unassigned
            nidaley Nigel Daley
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: