Issue is permissions when running with short-circuit reads. Recovering of the .META. log edits fails and so .META. is stuck in RIT till the test times out.
In the logs you see:
org.apache.hadoop.security.AccessControlException: Can't continue with getBlockLocalPathInfo() authorization. The user jenkins.hfs.4 is not allowed to call getBlockLocalPathInfo
The 'jenkins.hfs.4' is the RS trying to replay edits. It is failing because only the user 'jenkins' has perms to do short circuit reading.
The '.hfs.4' suffix is added in HBaseTestingUtility when we start up a little hbase cluster... it is added per regionserver.
So, we could reach back into the little mnincluster and IFF shortcircuit reads are enabled, then we have all RS use same user accessing hdfs.
But I think this will break tests. So I went the other route and disabled shortcircuit reading as the default for mini clusters. Quiet a few tests disable it already.
We probably need to add an explicit shortcircuit tests.
30 Patch that disables shortcircuit reading as default when running unit tests
29 because when a minicluster, not all regionservers have permissions to do
28 short circuit reading.
26 May slow tests some.
23 M hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKAssign.java
22 Unrelated: Shorten log message and add some context to explain a mysterious log.
20 M hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
19 Unrelated: Shorten a log message.
16 M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
15 Unrelated refactoring of a getMetaWAL method. This getMetaWAL is actually kinda
14 wrong in that it will do the creation if does not already exist which makes for
13 interesting parents:
11 2013-07-15 12:04:04,245 INFO [RS_OPEN_META-juno:36201-0MetaLogRoller] regionserver.LogRoller(119): LogRoller exiting.
9 An OPEN executor has the meta as its parent it seems which probably means
8 the executor has an occupied thread, a thread that won't go down. TODO.
6 Also fix name of metalogroller thread so it is like others.
4 M hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
3 Main fix changing short circuit read to default off.
1 M hbase-server/src/test/java/org/apache/hadoop/hbase/TestDrainingServer.java
0 Unrelated... add some sleep so we don't spew logs.