Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Sometimes when running HBaseBasedAuditRepositoryTest, the test is failing with a timeout. Logs reveal a specific kind of stack trace:
2016-04-18 15:11:44,437 FATAL - [10.200.4.44:49249.activeMasterManager:] ~ Unhandled exception. Starting shutdown. (HMaster:2098) org.apache.hadoop.hbase.util.FileSystemVersionException: HBase file layout needs to be upgraded. You have version null and I want version 8. Consult http://hbase.apache.org/book.html for further information about upgrading HBase. Is your hbase.rootdir valid? If so, you may need to run 'hbase hbck -fixVersionFile'. at org.apache.hadoop.hbase.util.FSUtils.checkVersion(FSUtils.java:677) at org.apache.hadoop.hbase.master.MasterFileSystem.checkRootDir(MasterFileSystem.java:455) at org.apache.hadoop.hbase.master.MasterFileSystem.createInitialFileSystemLayout(MasterFileSystem.java:146) at org.apache.hadoop.hbase.master.MasterFileSystem.<init>(MasterFileSystem.java:126) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:649) at org.apache.hadoop.hbase.master.HMaster.access$500(HMaster.java:182) at org.apache.hadoop.hbase.master.HMaster$1.run(HMaster.java:1646) at java.lang.Thread.run(Thread.java:745)
It appears that the HBase root directory is being set to /tmp/hbase-
{username}and if this has left over data it is failing. Under Mac OSX - this is resolving to a very hard to find directory by itself. Filing this to see if we can fix the temporary directories to be under the target folder of the module so that mvn clean actually will fix problems.