Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Critical Critical
    • Resolution: Duplicate
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: fs
    • Labels:
      None

      Description

      [todd@c0309 hadoop-trunk-home]$ ./bin/hadoop fs -copyToLocal /hbase/.META./1028785192/ /tmp/meta/
      copyToLocal: Fatal internal error
      java.lang.NullPointerException
      at org.apache.hadoop.fs.shell.PathData.getPathDataForChild(PathData.java:182)
      at org.apache.hadoop.fs.shell.CommandWithDestination.processPaths(CommandWithDestination.java:115)
      at org.apache.hadoop.fs.shell.Command.recursePath(Command.java:329)
      at org.apache.hadoop.fs.shell.Command.processPaths(Command.java:302)
      at org.apache.hadoop.fs.shell.CommandWithDestination.processPaths(CommandWithDestination.java:116)
      at org.apache.hadoop.fs.shell.Command.processPathArgument(Command.java:272)
      at org.apache.hadoop.fs.shell.Command.processArgument(Command.java:255)
      at org.apache.hadoop.fs.shell.Command.processArguments(Command.java:239)
      at org.apache.hadoop.fs.shell.CommandWithDestination.processArguments(CommandWithDestination.java:105)
      at org.apache.hadoop.fs.shell.Command.processRawArguments(Command.java:185)
      at org.apache.hadoop.fs.shell.Command.run(Command.java:149)

        Issue Links

          Activity

          Hide
          Uma Maheswara Rao G added a comment -

          Hi Todd,

          By looking the trace, I think the problem exist here.

          // need a static method for the ctor above
            private static FileStatus getStat(FileSystem fs, Path path)
            throws IOException {  
              FileStatus status = null;
              try {
                status = fs.getFileStatus(path);
              } catch (FileNotFoundException e) {} // ignore FNF
              return status;
            }
          

          In PathData, it is just ignoring the FileNotFoundException and returning null.

          Thanks
          Uma

          Show
          Uma Maheswara Rao G added a comment - Hi Todd, By looking the trace, I think the problem exist here. // need a static method for the ctor above private static FileStatus getStat(FileSystem fs, Path path) throws IOException { FileStatus status = null ; try { status = fs.getFileStatus(path); } catch (FileNotFoundException e) {} // ignore FNF return status; } In PathData, it is just ignoring the FileNotFoundException and returning null. Thanks Uma
          Hide
          Daryn Sharp added a comment -

          It's actually a bit more than that. The recursion is handled incorrectly in some cases. I've got a really old patch for this that I can put once 205 work is complete.

          Show
          Daryn Sharp added a comment - It's actually a bit more than that. The recursion is handled incorrectly in some cases. I've got a really old patch for this that I can put once 205 work is complete.
          Hide
          Uma Maheswara Rao G added a comment -

          Thanks Daryn!

          Show
          Uma Maheswara Rao G added a comment - Thanks Daryn!
          Hide
          Daryn Sharp added a comment -

          same issue

          Show
          Daryn Sharp added a comment - same issue

            People

            • Assignee:
              Daryn Sharp
              Reporter:
              Todd Lipcon
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development