Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1991

Task startup fail when localizeTask directory is full

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Duplicate
    • None
    • None
    • None
    • None

    Description

      We had a job filling up one particular drive (different bug) that resulted in all the subsequent tasks on that node to fail with
      java.io.IOException: Mkdirs failed to create /vol2/mapred-tt/mapred-local/taskTracker/jobcache/job_200710030011_0001/task_200710030011_0001_m_007363_0
      at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.localizeTask(TaskTracker.java:1284)
      at org.apache.hadoop.mapred.TaskTracker$TaskInProgress.launchTask(TaskTracker.java:1344)
      at org.apache.hadoop.mapred.TaskTracker.launchTaskForJob(TaskTracker.java:647)
      at org.apache.hadoop.mapred.TaskTracker.localizeJob(TaskTracker.java:640)
      at org.apache.hadoop.mapred.TaskTracker.startNewTask(TaskTracker.java:1167)
      at org.apache.hadoop.mapred.TaskTracker.offerService(TaskTracker.java:832)
      at org.apache.hadoop.mapred.TaskTracker.run(TaskTracker.java:1203)
      at org.apache.hadoop.mapred.TaskTracker.main(TaskTracker.java:1888)

      It'll be nice if localization also uses localdirallocator to utilize multiple disks.

      Attachments

        Activity

          People

            amareshwari Amareshwari Sriramadasu
            knoguchi Koji Noguchi
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: