Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-13379

Failure when running dfs command on a wasb url

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: 3.0.1
    • Fix Version/s: None
    • Component/s: fs
    • Labels:
      None
    • Environment:

      Ubuntu 16

      Description

       

      hdfs dfs -fs wasb://hdfs@MY_ACCOUNT.blob.core.windows.net/ -ls /
      -ls: Fatal internal error
      java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found
      at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2559)
      at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3254)
      at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3286)
      at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:123)
      at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3337)
      at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3305)
      at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:476)
      at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:225)
      at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:460)
      at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361)
      at org.apache.hadoop.fs.shell.PathData.expandAsGlob(PathData.java:325)
      at org.apache.hadoop.fs.shell.Command.expandArgument(Command.java:249)
      at org.apache.hadoop.fs.shell.Command.expandArguments(Command.java:232)
      at org.apache.hadoop.fs.shell.FsCommand.processRawArguments(FsCommand.java:103)
      at org.apache.hadoop.fs.shell.Command.run(Command.java:176)
      at org.apache.hadoop.fs.FsShell.run(FsShell.java:328)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
      at org.apache.hadoop.fs.FsShell.main(FsShell.java:391)
      Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.azure.NativeAzureFileSystem not found
      at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2463)
      at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2557)
      ... 18 more
      

       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jackalcooper Jackal Tsai
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated: