Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.8.0
    • Fix Version/s: 2.9.0, 2.8.2
    • Component/s: fs/adl
    • Labels:
      None

      Description

      $ bin/hadoop fs -ls /
      ls: No FileSystem for scheme: adl
      

      The problem is core-default.xml misses property fs.adl.impl and fs.AbstractFileSystem.adl.impl.

      After adding these 2 properties to etc/hadoop/core-sitex.xml, got this error:

      $ bin/hadoop fs -ls /
      -ls: Fatal internal error
      java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.adl.AdlFileSystem not found
      	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2231)
      	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3207)
      	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3239)
      	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:121)
      	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3290)
      	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3258)
      	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:470)
      	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:223)
      	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:454)
      	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
      	at org.apache.hadoop.fs.shell.PathData.expandAsGlob(PathData.java:325)
      	at org.apache.hadoop.fs.shell.Command.expandArgument(Command.java:245)
      	at org.apache.hadoop.fs.shell.Command.expandArguments(Command.java:228)
      	at org.apache.hadoop.fs.shell.FsCommand.processRawArguments(FsCommand.java:103)
      	at org.apache.hadoop.fs.shell.Command.run(Command.java:175)
      	at org.apache.hadoop.fs.FsShell.run(FsShell.java:315)
      	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
      	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
      	at org.apache.hadoop.fs.FsShell.main(FsShell.java:378)
      Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.adl.AdlFileSystem not found
      	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2137)
      	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2229)
      	... 18 more
      

      The problem is ADLS jars are not copied to share/hadoop/tools/lib.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                jzhuge John Zhuge
                Reporter:
                jzhuge John Zhuge
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: