[HDFS-14907] [Dynamometer] DataNode can't find junit jar when using Hadoop-3 binary

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.3.0
• Assignee: Takanobu Asanuma
• Reporter: Takanobu Asanuma
• Created: 15/Oct/19 01:16
• Updated: 30/Oct/19 01:37
• Resolved: 30/Oct/19 01:37

Description

When executing start-dynamometer-cluster.sh with Hadoop-3 binary, datanodes fail to run with the following log and start-dynamometer-cluster.sh fails.

LogType:stderr
LogLastModifiedTime:Wed Oct 09 15:03:09 +0900 2019
LogLength:1386
LogContents:
Exception in thread "main" java.lang.NoClassDefFoundError: org/junit/Assert
        at org.apache.hadoop.test.GenericTestUtils.assertExists(GenericTestUtils.java:299)
        at org.apache.hadoop.test.GenericTestUtils.getTestDir(GenericTestUtils.java:243)
        at org.apache.hadoop.test.GenericTestUtils.getTestDir(GenericTestUtils.java:252)
        at org.apache.hadoop.hdfs.MiniDFSCluster.getBaseDirectory(MiniDFSCluster.java:2982)
        at org.apache.hadoop.hdfs.MiniDFSCluster.determineDfsBaseDir(MiniDFSCluster.java:2972)
        at org.apache.hadoop.hdfs.MiniDFSCluster.formatDataNodeDirs(MiniDFSCluster.java:2834)
        at org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.run(SimulatedDataNodes.java:123)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:76)
        at org.apache.hadoop.tools.dynamometer.SimulatedDataNodes.main(SimulatedDataNodes.java:88)
Caused by: java.lang.ClassNotFoundException: org.junit.Assert
        at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        ... 9 more
./start-component.sh: line 317: kill: (2261) - No such process

Issue Links

• is related to: HDFS-14717 Junit not found in hadoop-dynamometer-infra
• links to: GitHub Pull Request #1680