Hadoop Common
  1. Hadoop Common
  2. HADOOP-6560

HarFileSystem throws NPE for har://hdfs-/foo

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.21.0
    • Component/s: fs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      -bash-3.1$ hadoop distcp -Dmapred.job.queue.name=${JOBQ}  har://hdfs-/user/tsz/t10_4.har/t10_4 t10_4_distcp t10_4_distcp
      10/01/28 23:20:45 INFO tools.DistCp: srcPaths=[har://hdfs-/user/tsz/t10_4.har/t10_4]
      10/01/28 23:20:45 INFO tools.DistCp: destPath=t10_4_distcp
      With failures, global counters are inaccurate; consider running with -i
      Copy failed: java.lang.NullPointerException
              at org.apache.hadoop.fs.HarFileSystem.decodeHarURI(HarFileSystem.java:184)
              at org.apache.hadoop.fs.HarFileSystem.initialize(HarFileSystem.java:95)
              ...
      
      1. c6560_20100212_y0.20.patch
        2 kB
        Tsz Wo Nicholas Sze
      2. c6560_20100212.patch
        3 kB
        Tsz Wo Nicholas Sze
      3. c6560_20100211.patch
        1 kB
        Tsz Wo Nicholas Sze

        Issue Links

          Activity

          Tsz Wo Nicholas Sze created issue -
          Tsz Wo Nicholas Sze made changes -
          Field Original Value New Value
          Assignee Mahadev konar [ mahadev ]
          Tsz Wo Nicholas Sze made changes -
          Project Hadoop Map/Reduce [ 12310941 ] Hadoop Common [ 12310240 ]
          Key MAPREDUCE-1427 HADOOP-6560
          Fix Version/s 0.22.0 [ 12314296 ]
          Fix Version/s 0.22.0 [ 12314184 ]
          Component/s fs [ 12310689 ]
          Component/s harchive [ 12312903 ]
          Tsz Wo Nicholas Sze made changes -
          Summary archive throws NPE for har://hdfs-/foo HarFileSystem throws NPE for har://hdfs-/foo
          Description {noformat}
          -bash-3.1$ hadoop distcp -Dmapred.job.queue.name=${JOBQ} har://hdfs-/user/tsz/t10_4.har/t10_4 t10_4_distcp t10_4_distcp
          10/01/28 23:20:45 INFO tools.DistCp: srcPaths=[har://hdfs-/user/tsz/t10_4.har/t10_4]
          10/01/28 23:20:45 INFO tools.DistCp: destPath=t10_4_distcp
          With failures, global counters are inaccurate; consider running with -i
          Copy failed: java.lang.NullPointerException
                  at org.apache.hadoop.fs.HarFileSystem.decodeHarURI(HarFileSystem.java:184)
                  at org.apache.hadoop.fs.HarFileSystem.initialize(HarFileSystem.java:95)
                  at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:1378)
                  at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:193)
                  at org.apache.hadoop.fs.Path.getFileSystem(Path.java:175)
                  at org.apache.hadoop.tools.DistCp.checkSrcPath(DistCp.java:626)
                  at org.apache.hadoop.tools.DistCp.copy(DistCp.java:644)
                  at org.apache.hadoop.tools.DistCp.run(DistCp.java:871)
                  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
                  at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
                  at org.apache.hadoop.tools.DistCp.main(DistCp.java:898)
          {noformat}
          {noformat}
          -bash-3.1$ hadoop distcp -Dmapred.job.queue.name=${JOBQ} har://hdfs-/user/tsz/t10_4.har/t10_4 t10_4_distcp t10_4_distcp
          10/01/28 23:20:45 INFO tools.DistCp: srcPaths=[har://hdfs-/user/tsz/t10_4.har/t10_4]
          10/01/28 23:20:45 INFO tools.DistCp: destPath=t10_4_distcp
          With failures, global counters are inaccurate; consider running with -i
          Copy failed: java.lang.NullPointerException
                  at org.apache.hadoop.fs.HarFileSystem.decodeHarURI(HarFileSystem.java:184)
                  at org.apache.hadoop.fs.HarFileSystem.initialize(HarFileSystem.java:95)
                  ...
          {noformat}
          Tsz Wo Nicholas Sze made changes -
          Attachment c6560_20100211.patch [ 12435633 ]
          Tsz Wo Nicholas Sze made changes -
          Attachment c6560_20100212.patch [ 12435753 ]
          Tsz Wo Nicholas Sze made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Mahadev konar made changes -
          Assignee Mahadev konar [ mahadev ] Tsz Wo (Nicholas), SZE [ szetszwo ]
          Tsz Wo Nicholas Sze made changes -
          Attachment c6560_20100212_y0.20.patch [ 12436045 ]
          Tsz Wo Nicholas Sze made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Tom White made changes -
          Fix Version/s 0.21.0 [ 12313563 ]
          Fix Version/s 0.22.0 [ 12314296 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Carl Steinbach made changes -
          Link This issue relates to HADOOP-8053 [ HADOOP-8053 ]

            People

            • Assignee:
              Tsz Wo Nicholas Sze
              Reporter:
              Tsz Wo Nicholas Sze
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development