Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3766

dumptb fails with filenotfound

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Not A Problem
    • Affects Version/s: 0.20.2
    • Fix Version/s: None
    • Component/s: contrib/streaming
    • Labels:
      None
    • Environment:

      AWS, ubuntu, cdh3u3

      Description

      dumptb can't find an existing file

      antonio@ip-10-9-65-123:~$ hadoop jar /usr/lib/hadoop/contrib/streaming/hadoop-streaming-0.20.2-cdh3u3.jar dumptb /tmp/Rtmp5h8lIO/file179e4fc
      12/01/31 00:27:48 INFO security.UserGroupInformation: JAAS Configuration already set up for Hadoop, not re-installing.
      12/01/31 00:27:49 WARN snappy.LoadSnappy: Snappy native library is available
      12/01/31 00:27:49 INFO util.NativeCodeLoader: Loaded the native-hadoop library
      12/01/31 00:27:49 INFO snappy.LoadSnappy: Snappy native library loaded
      Exception in thread "main" java.io.FileNotFoundException: File does not exist: /tmp/Rtmp5h8lIO/file179e4fc/_logs
      at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1822)
      at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1813)
      at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:544)
      at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:187)
      at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:456)
      at org.apache.hadoop.streaming.AutoInputFormat.getRecordReader(AutoInputFormat.java:56)
      at org.apache.hadoop.streaming.DumpTypedBytes.dumpTypedBytes(DumpTypedBytes.java:102)
      at org.apache.hadoop.streaming.DumpTypedBytes.run(DumpTypedBytes.java:83)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
      at org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:41)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:197)

      But the file is there

      antonio@ip-10-9-65-123:~$ hadoop dfs -ls /tmp/Rtmp5h8lIO/file179e4fc/_logs
      12/01/31 00:28:47 INFO security.UserGroupInformation: JAAS Configuration already set up for Hadoop, not re-installing.
      Found 1 items
      drwxrwxrwx - antonio supergroup 0 2012-01-31 00:18 /tmp/Rtmp5h8lIO/file179e4fc/_logs/history

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              piccolbo Antonio Piccolboni
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: