Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3766

dumptb fails with filenotfound

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Not A Problem
    • 0.20.2
    • None
    • contrib/streaming
    • None
    • AWS, ubuntu, cdh3u3

    Description

      dumptb can't find an existing file

      antonio@ip-10-9-65-123:~$ hadoop jar /usr/lib/hadoop/contrib/streaming/hadoop-streaming-0.20.2-cdh3u3.jar dumptb /tmp/Rtmp5h8lIO/file179e4fc
      12/01/31 00:27:48 INFO security.UserGroupInformation: JAAS Configuration already set up for Hadoop, not re-installing.
      12/01/31 00:27:49 WARN snappy.LoadSnappy: Snappy native library is available
      12/01/31 00:27:49 INFO util.NativeCodeLoader: Loaded the native-hadoop library
      12/01/31 00:27:49 INFO snappy.LoadSnappy: Snappy native library loaded
      Exception in thread "main" java.io.FileNotFoundException: File does not exist: /tmp/Rtmp5h8lIO/file179e4fc/_logs
      at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.openInfo(DFSClient.java:1822)
      at org.apache.hadoop.hdfs.DFSClient$DFSInputStream.<init>(DFSClient.java:1813)
      at org.apache.hadoop.hdfs.DFSClient.open(DFSClient.java:544)
      at org.apache.hadoop.hdfs.DistributedFileSystem.open(DistributedFileSystem.java:187)
      at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:456)
      at org.apache.hadoop.streaming.AutoInputFormat.getRecordReader(AutoInputFormat.java:56)
      at org.apache.hadoop.streaming.DumpTypedBytes.dumpTypedBytes(DumpTypedBytes.java:102)
      at org.apache.hadoop.streaming.DumpTypedBytes.run(DumpTypedBytes.java:83)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
      at org.apache.hadoop.streaming.HadoopStreaming.main(HadoopStreaming.java:41)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at org.apache.hadoop.util.RunJar.main(RunJar.java:197)

      But the file is there

      antonio@ip-10-9-65-123:~$ hadoop dfs -ls /tmp/Rtmp5h8lIO/file179e4fc/_logs
      12/01/31 00:28:47 INFO security.UserGroupInformation: JAAS Configuration already set up for Hadoop, not re-installing.
      Found 1 items
      drwxrwxrwx - antonio supergroup 0 2012-01-31 00:18 /tmp/Rtmp5h8lIO/file179e4fc/_logs/history

      Attachments

        Activity

          People

            Unassigned Unassigned
            piccolbo Antonio Piccolboni
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: