[YARN-10733] TimelineService Hbase tests are failing with timeout error on branch-2.10

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.10.0
• Fix Version/s: 2.10.2
• Component/s: test, timelineserver, yarn
• Labels: pull-request-available
• Assignee: Ahmed Hussein
• Reporter: Ahmed Hussein
• Created: 12/Apr/21 18:33
• Updated: 15/Apr/21 19:01
• Resolved: 14/Apr/21 18:45

Description

03:54:41 [ERROR] Failed to execute goal org.apache.maven.plugins:maven-surefire-plugin:2.22.2:test (default-test) on project hadoop-yarn-server-timelineservice-hbase-tests: There was a timeout or other error in the fork -> [Help 1]
03:54:41 [ERROR] 
03:54:41 [ERROR] To see the full stack trace of the errors, re-run Maven with the -e switch.
03:54:41 [ERROR] Re-run Maven using the -X switch to enable full debug logging.
03:54:41 [ERROR] 
03:54:41 [ERROR] For more information about the errors and possible solutions, please read the following articles:
03:54:41 [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/MojoFailureException
03:54:41 [ERROR] 
03:54:41 [ERROR] After correcting the problems, you can resume the build with the command
03:54:41 [ERROR]   mvn <args> -rf :hadoop-yarn-server-timelineservice-hbase-tests

Failure of the tests is due to test unit TestHBaseStorageFlowRunCompaction getting stuck.
Upon checking the surefire reports, I found several Class no Found Exceptions.

Caused by: java.lang.NoClassDefFoundError: org/apache/hadoop/fs/CanUnbuffer
	at java.lang.ClassLoader.defineClass1(Native Method)
	at java.lang.ClassLoader.defineClass(ClassLoader.java:763)
	at java.security.SecureClassLoader.defineClass(SecureClassLoader.java:142)
	at java.net.URLClassLoader.defineClass(URLClassLoader.java:468)
	at java.net.URLClassLoader.access$100(URLClassLoader.java:74)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:369)
	at java.net.URLClassLoader$1.run(URLClassLoader.java:363)
	at java.security.AccessController.doPrivileged(Native Method)
	at java.net.URLClassLoader.findClass(URLClassLoader.java:362)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	at org.apache.hadoop.hbase.regionserver.StoreFileInfo.<clinit>(StoreFileInfo.java:66)
	at org.apache.hadoop.hbase.regionserver.HStore.createStoreFileAndReader(HStore.java:698)
	at org.apache.hadoop.hbase.regionserver.HStore.validateStoreFile(HStore.java:1895)
	at org.apache.hadoop.hbase.regionserver.HStore.flushCache(HStore.java:1009)
	at org.apache.hadoop.hbase.regionserver.HStore$StoreFlusherImpl.flushCache(HStore.java:2523)
	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushCacheAndCommit(HRegion.java:2638)
	... 33 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.fs.CanUnbuffer
	at java.net.URLClassLoader.findClass(URLClassLoader.java:382)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:349)
	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
	... 51 more

and

Caused by: java.lang.NoClassDefFoundError: Could not initialize class org.apache.hadoop.hbase.regionserver.StoreFileInfo
	at org.apache.hadoop.hbase.regionserver.HStore.createStoreFileAndReader(HStore.java:698)
	at org.apache.hadoop.hbase.regionserver.HStore.validateStoreFile(HStore.java:1895)
	at org.apache.hadoop.hbase.regionserver.HStore.flushCache(HStore.java:1009)
	at org.apache.hadoop.hbase.regionserver.HStore$StoreFlusherImpl.flushCache(HStore.java:2523)
	at org.apache.hadoop.hbase.regionserver.HRegion.internalFlushCacheAndCommit(HRegion.java:2638)
	... 10 more

Issue Links

• links to: GitHub Pull Request #2899