[HBASE-16985] TestClusterId failed due to wrong hbase rootdir

• Type: Bug
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.3.0, 1.4.0, 1.1.7, 1.2.4, 2.0.0
• Fix Version/s: 1.4.0, 1.2.5, 1.1.9, 2.0.0
• Component/s: test
• Hadoop Flags: Reviewed
• Assignee: Guanghao Zhang
• Reporter: Guanghao Zhang
• Created: 01/Nov/16 14:33
• Updated: 19/Nov/17 04:38
• Resolved: 08/Dec/16 02:20

Description

https://builds.apache.org/job/PreCommit-HBASE-Build/4253/testReport/org.apache.hadoop.hbase.regionserver/TestClusterId/testClusterId/

java.io.IOException: Shutting down
	at org.apache.hadoop.hbase.util.JVMClusterUtil.startup(JVMClusterUtil.java:230)
	at org.apache.hadoop.hbase.LocalHBaseCluster.startup(LocalHBaseCluster.java:409)
	at org.apache.hadoop.hbase.MiniHBaseCluster.init(MiniHBaseCluster.java:227)
	at org.apache.hadoop.hbase.MiniHBaseCluster.<init>(MiniHBaseCluster.java:96)
	at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:1071)
	at org.apache.hadoop.hbase.HBaseTestingUtility.startMiniHBaseCluster(HBaseTestingUtility.java:1037)
	at org.apache.hadoop.hbase.regionserver.TestClusterId.testClusterId(TestClusterId.java:85)

The cluster can not start up because there are no active master. The active master can not finish initialing because the hbase:namespace region can not be assign.

In TestClusterId unit test, TEST_UTIL.startMiniHBaseCluster set new hbase root dir. But the regionserver thread which stared first used a different hbase root dir. If assign hbase:namespace region to this regionserver, the region can not be assigned because there are no tableinfo on wrong hbase root dir.

When regionserver report to master, it will get back some new config. But the FSTableDescriptors has been initialed so it's root dir didn't changed.

if (LOG.isDebugEnabled()) {
    LOG.info("Config from master: " + key + "=" + value);
}

I thought FSTableDescriptors need update the rootdir when regionserver get report from master.

The master branch has same problem, too. But the balancer always assign hbase:namesapce region to master. So this unit test can passed on master branch.

Issue Links

• relates to: HBASE-18938 Backport HBASE-16985 to branch-1.3