Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-1234

map tasks fail because they do not find application in file cache

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.12.1
    • 0.14.0
    • None
    • None

    Description

      Using C++ map-reduce interface, a lot of tasks fail because they do not find the application in the file cache.
      Might be a race condition between multiple tasks on the same node.

      java.io.IOException: Cannot run program "<path>/mapred/local/taskTracker/archive/<namenodehost>/<path>/<application>": java.io.IOException: error=2, No such file or directory
      at java.lang.ProcessBuilder.start(ProcessBuilder.java:459)
      at org.apache.hadoop.mapred.pipes.Application.runClient(Application.java:131)
      at org.apache.hadoop.mapred.pipes.Application.(Application.java:59)
      at org.apache.hadoop.mapred.pipes.PipesMapRunner.run(PipesMapRunner.java:44)
      at org.apache.hadoop.mapred.MapTask.run(MapTask.java:176)
      at org.apache.hadoop.mapred.TaskTracker$Child.main(TaskTracker.java:1459)
      Caused by: java.io.IOException: java.io.IOException: error=2, No such file or directory
      at java.lang.UNIXProcess.(UNIXProcess.java:148)
      at java.lang.ProcessImpl.start(ProcessImpl.java:65)
      at java.lang.ProcessBuilder.start(ProcessBuilder.java:452)
      ... 5 more

      Attachments

        1. HADOOP-1234_1_20070514.patch
          2 kB
          Arun Murthy
        2. HADOOP-1234_2_20070611.patch
          2 kB
          Arun Murthy

        Activity

          People

            acmurthy Arun Murthy
            ckunz Christian Kunz
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: