[HADOOP-14205] No FileSystem for scheme: adl

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.8.0
• Fix Version/s: 2.9.0, 2.8.2
• Component/s: fs/adl
• Target Version/s: 2.9.0, 2.8.1
• Assignee: John Zhuge
• Reporter: John Zhuge
• Created: 20/Mar/17 16:00
• Updated: 08/Jun/17 00:16
• Resolved: 21/Mar/17 16:30

Description

$ bin/hadoop fs -ls /
ls: No FileSystem for scheme: adl

The problem is core-default.xml misses property fs.adl.impl and fs.AbstractFileSystem.adl.impl.

After adding these 2 properties to etc/hadoop/core-sitex.xml, got this error:

$ bin/hadoop fs -ls /
-ls: Fatal internal error
java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.adl.AdlFileSystem not found
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2231)
	at org.apache.hadoop.fs.FileSystem.getFileSystemClass(FileSystem.java:3207)
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3239)
	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:121)
	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3290)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3258)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:470)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:223)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:454)
	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:356)
	at org.apache.hadoop.fs.shell.PathData.expandAsGlob(PathData.java:325)
	at org.apache.hadoop.fs.shell.Command.expandArgument(Command.java:245)
	at org.apache.hadoop.fs.shell.Command.expandArguments(Command.java:228)
	at org.apache.hadoop.fs.shell.FsCommand.processRawArguments(FsCommand.java:103)
	at org.apache.hadoop.fs.shell.Command.run(Command.java:175)
	at org.apache.hadoop.fs.FsShell.run(FsShell.java:315)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
	at org.apache.hadoop.fs.FsShell.main(FsShell.java:378)
Caused by: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.adl.AdlFileSystem not found
	at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2137)
	at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:2229)
	... 18 more

The problem is ADLS jars are not copied to share/hadoop/tools/lib.

Issue Links

• is broken by: HADOOP-13037 Refactor Azure Data Lake Store as an independent FileSystem