[YARN-6414] ATSv2 HBase related tests fail due to guava version upgrade

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha4
• Fix Version/s: 2.9.0, 3.0.0-alpha4
• Component/s: timelineserver
• Labels: ppc64le x86_64

Environment

Ubuntu 14.04
x86, ppc64le
$ java -version
openjdk version "1.8.0_111"
OpenJDK Runtime Environment (build 1.8.0_111-8u111-b14-3~14.04.1-b14)
OpenJDK 64-Bit Server VM (build 25.111-b14, mixed mode)

• Hadoop Flags: Reviewed
• Assignee: Haibo Chen
• Reporter: Sonia Garudi
• Created: 30/Mar/17 11:15
• Updated: 21/Oct/17 06:06
• Resolved: 01/Apr/17 23:12

Description

Test failures seen in Hadoop YARN Timeline Service HBase tests project with following error :

java.lang.NoClassDefFoundError: com/google/common/io/LimitInputStream
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at org.apache.hadoop.hdfs.server.namenode.FSImageFormat$LoaderDelegator.load(FSImageFormat.java:223)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:913)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:899)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImageFile(FSImage.java:722)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:660)
        at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:279)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFSImage(FSNamesystem.java:955)
        at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.loadFromDisk(FSNamesystem.java:700)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.loadNamesystem(NameNode.java:529)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:585)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:751)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.<init>(NameNode.java:735)
        at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1407)
        at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNode(MiniDFSCluster.java:998)
        at org.apache.hadoop.hdfs.MiniDFSCluster.createNameNodesAndSetConf(MiniDFSCluster.java:869)
        at org.apache.hadoop.hdfs.MiniDFSCluster.initMiniDFSCluster(MiniDFSCluster.java:704)
        at org.apache.hadoop.hdfs.MiniDFSCluster.<init>(MiniDFSCluster.java:642)
        at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniDFSCluster(HBaseTestingUtility.java:590)
        at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:987)
        at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:868)
        at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:862)
        at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniCluster(HBaseTestingUtility.java:806)
        at org.apache.hadoop.yarn.server.timelineservice.reader.TestTimelineReaderWebServicesHBaseStorage.setup(TestTimelineReaderWebServicesHBaseStorage.java:88)

Below are the failing tests :

TestTimelineReaderWebServicesHBaseStorage.setup:88 » NoClassDefFound com/googl...
  TestHBaseTimelineStorageEntities.setupBeforeClass:100 » NoClassDefFound com/go...
  TestHBaseStorageFlowActivity.setupBeforeClass:72 » NoClassDefFound com/google/...
  TestHBaseStorageFlowRunCompaction.setupBeforeClass:84 » NoClassDefFound com/go...
  TestHBaseStorageFlowRun.setupBeforeClass:86 » NoClassDefFound com/google/commo...
  TestHBaseTimelineStorageApps.setupBeforeClass:93 » NoClassDefFound com/google/...

Issue Links

• is broken by: HADOOP-10101 Update guava dependency to the latest version
• is related to: YARN-5071 address HBase compatibility issues with trunk
• relates to: YARN-6564 RM service is shutting down when ATS v2 is enabled