[PIG-2977] TestHBaseStorage fails with hadoop-2.0.x

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Fix Version/s: 0.11
• Assignee: Unassigned
• Reporter: Cheolsoo Park
• Created: 15/Oct/12 21:19
• Updated: 02/May/13 02:29
• Resolved: 17/Oct/12 18:45

Description

To reproduce, please run:

ant clean test -Dtestcase=TestHBaseStorage -Dhadoopversion=23

In the test log, HBase master fails to start with the following error:

2012-10-15 14:01:28,455 FATAL [Master:0;cheolsoo-mr2-1.ent.cloudera.com:46920] master.HMaster (HMaster.java:abort(936)) - Unhandled exception. Starting shutdown.
java.lang.NoClassDefFoundError: org/apache/hadoop/hdfs/protocol/FSConstants$SafeModeAction
        at org.apache.hadoop.hbase.util.FSUtils.waitOnSafeMode(FSUtils.java:280)
        at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:229)
        at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:105)
        at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:90)
        at org.apache.hadoop.hbase.master.HMaster.finishInitialization(HMaster.java:341)
        at org.apache.hadoop.hbase.master.HMaster.run(HMaster.java:277)
        at java.lang.Thread.run(Thread.java:662)

This is because hbase.jar in the maven repository is not compatible with hadoop 23/2.0 (HBASE-5680).

The proposed fix is to disable this test in MR2.

Issue Links

• is depended upon by: PIG-2885 TestJobSumission and TestHBaseStorage don't work with HBase 0.94 and ZK 3.4.3