[YARN-8899] TestCleanupAfterKIll is failing due to unsatisfied dependencies

• Type: Improvement
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: yarn-native-services
• Target Version/s: 3.3.0
• Assignee: Robert Kanter
• Reporter: Eric Yang
• Created: 17/Oct/18 18:35
• Updated: 19/Oct/18 17:10
• Resolved: 18/Oct/18 19:47

Description

BouncyCastle upgrade cause unit test to fail due to unsatisfied transitive dependencies.
It looks like the new version of bcprov-jdk15on bring in a new dependency bcpkix-jdk15on. Minicluster does not have bcpkix-jdk15on dependency and cause unit test that depends on minicluster to fail.

[ERROR] testRegistryCleanedOnLifetimeExceeded(org.apache.hadoop.yarn.service.TestCleanupAfterKill)  Time elapsed: 2.709 s  <<< ERROR!
java.lang.NoClassDefFoundError: org/bouncycastle/operator/OperatorCreationException
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager$RMActiveServices.serviceInit(ResourceManager.java:836)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.createAndInitActiveServices(ResourceManager.java:1256)
	at org.apache.hadoop.yarn.server.resourcemanager.ResourceManager.serviceInit(ResourceManager.java:324)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
	at org.apache.hadoop.yarn.server.MiniYARNCluster.initResourceManager(MiniYARNCluster.java:348)
	at org.apache.hadoop.yarn.server.MiniYARNCluster.access$200(MiniYARNCluster.java:128)
	at org.apache.hadoop.yarn.server.MiniYARNCluster$ResourceManagerWrapper.serviceInit(MiniYARNCluster.java:497)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
	at org.apache.hadoop.service.CompositeService.serviceInit(CompositeService.java:108)
	at org.apache.hadoop.yarn.server.MiniYARNCluster.serviceInit(MiniYARNCluster.java:316)
	at org.apache.hadoop.service.AbstractService.init(AbstractService.java:164)
	at org.apache.hadoop.yarn.service.ServiceTestUtils.setupInternal(ServiceTestUtils.java:251)
	at org.apache.hadoop.yarn.service.TestCleanupAfterKill.testRegistryCleanedOnLifetimeExceeded(TestCleanupAfterKill.java:66)
	at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
	at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
	at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
	at java.lang.reflect.Method.invoke(Method.java:498)
	at org.junit.runners.model.FrameworkMethod$1.runReflectiveCall(FrameworkMethod.java:47)
	at org.junit.internal.runners.model.ReflectiveCallable.run(ReflectiveCallable.java:12)
	at org.junit.runners.model.FrameworkMethod.invokeExplosively(FrameworkMethod.java:44)
	at org.junit.internal.runners.statements.InvokeMethod.evaluate(InvokeMethod.java:17)
	at org.junit.internal.runners.statements.FailOnTimeout$StatementThread.run(FailOnTimeout.java:74)
Caused by: java.lang.ClassNotFoundException: org.bouncycastle.operator.OperatorCreationException
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 23 more

Issue Links

• is broken by: YARN-8448 AM HTTPS Support for AM communication with RMWeb proxy
• is broken by: HADOOP-15832 Upgrade BouncyCastle to 1.60
• is related to: YARN-8919 Some tests fail due to NoClassDefFoundError for OperatorCreationException