[YARN-8492] ATSv2 HBase tests are failing with ClassNotFoundException

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Labels: atsv2 test
• Target Version/s: 3.2.0
• Hadoop Flags: Reviewed
• Assignee: Rohith Sharma K S
• Reporter: Rohith Sharma K S
• Created: 04/Jul/18 05:17
• Updated: 15/Feb/19 06:03
• Resolved: 06/Jul/18 19:06

Description

It is seen in recent QA report that ATSv2 Hbase tests are failing with ClassNotFoundException.

This looks to be regression from hadoop common patch or any other patch. We need to figure out which JIRA broke this and fix tests failure.

     hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRun
      hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageSchema
      hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageEntities
      hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps
      hadoop.yarn.server.timelineservice.storage.TestTimelineReaderHBaseDown
      hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowRunCompaction
      hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageDomain
      hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage
      hadoop.yarn.server.timelineservice.storage.flow.TestHBaseStorageFlowActivity

 

ERROR] org.apache.hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps  Time elapsed: 0.102 s  <<< ERROR!
java.lang.NoClassDefFoundError: org/apache/hadoop/crypto/key/KeyProviderTokenIssuer
	at java.lang.ClassLoader.defineClass1(Native Method)
	at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
	at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
	at java.net.URLClassLoader.defineClass(URLClassLoader.java:467)
	at java.net.URLClassLoader.access$100(URLClassLoader.java:73)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:368)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:362)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:361)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at org.apache.hadoop.yarn.server.timelineservice.storage.TestHBaseTimelineStorageApps.setupBeforeClass(TestHBaseTimelineStorageApps.java:97)
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.crypto.key.KeyProviderTokenIssuer
	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)

Issue Links

• is broken by: YARN-8273 Log aggregation does not warn if HDFS quota in target directory is exceeded
• is related to: YARN-8497 ATSv2 HBase tests failures with 'Incorrect response from timeline reader'