[HDDS-481] Classes are missing from the shaded ozonefs jar

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.2.1
• Component/s: Ozone Filesystem
• Target Version/s: 0.2.1
• Assignee: Bharat Viswanadham
• Reporter: Marton Elek
• Created: 17/Sep/18 13:48
• Updated: 12/Nov/18 11:10
• Resolved: 18/Sep/18 08:51

Description

Ozonefs acceptance test contains only one simple command which is executed on an ozone node with ozone fs.

Unfortunately the hdfs fs command doesn't work with ozone fs due to a missing class file.

To test:

cd hadoop-dist/target/ozone-0.2.1-SNAPSHOT/compose/ozonefs
docker-compose exec scm ozone sh volume create --user hadoop /vol1
docker-compose exec scm ozone sh bucket create /vol1/bucket
docker-compose exec hadooplast hdfs dfs -ls o3://bucket.vol1/

The result is:

2018-09-17 13:48:08 INFO  Configuration:3204 - Removed undeclared tags:
2018-09-17 13:48:08 INFO  Configuration:3204 - Removed undeclared tags:
Exception in thread "main" java.lang.NoClassDefFoundError: org/apache/ratis/shaded/proto/RaftProtos$ReplicationLevel
	at org.apache.hadoop.hdds.scm.ScmConfigKeys.<clinit>(ScmConfigKeys.java:64)
	at org.apache.hadoop.ozone.OzoneConfigKeys.<clinit>(OzoneConfigKeys.java:221)
	at org.apache.hadoop.ozone.client.OzoneBucket.<init>(OzoneBucket.java:116)
	at org.apache.hadoop.ozone.client.rpc.RpcClient.getBucketDetails(RpcClient.java:420)
	at org.apache.hadoop.ozone.client.OzoneVolume.getBucket(OzoneVolume.java:199)
	at org.apache.hadoop.fs.ozone.OzoneFileSystem.initialize(OzoneFileSystem.java:122)
	at org.apache.hadoop.fs.FileSystem.createFileSystem(FileSystem.java:3354)
	at org.apache.hadoop.fs.FileSystem.access$200(FileSystem.java:124)
	at org.apache.hadoop.fs.FileSystem$Cache.getInternal(FileSystem.java:3403)
	at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:3371)
	at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:477)
	at org.apache.hadoop.fs.Path.getFileSystem(Path.java:361)
	at org.apache.hadoop.fs.shell.PathData.expandAsGlob(PathData.java:325)
	at org.apache.hadoop.fs.shell.Command.expandArgument(Command.java:249)
	at org.apache.hadoop.fs.shell.Command.expandArguments(Command.java:232)
	at org.apache.hadoop.fs.shell.FsCommand.processRawArguments(FsCommand.java:104)
	at org.apache.hadoop.fs.shell.Command.run(Command.java:176)
	at org.apache.hadoop.fs.FsShell.run(FsShell.java:328)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
	at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:90)
	at org.apache.hadoop.fs.FsShell.main(FsShell.java:391)
Caused by: java.lang.ClassNotFoundException: org.apache.ratis.shaded.proto.RaftProtos$ReplicationLevel
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 21 more