[HBASE-9526] LocalHBaseCluster.shutdown hangs for regionserver thread wait zk deleteMyEphemeralNode packet.

• Type: Test
• Status: Closed
• Priority: Minor
• Resolution: Incomplete
• Affects Version/s: 0.94.3
• Assignee: Unassigned
• Reporter: Shaohui Liu
• Created: 13/Sep/13 02:55
• Updated: 16/Jun/22 18:05
• Resolved: 16/Jun/22 18:05

Description

When LocalHBaseCluster is shutdowned, it will join all regionserver threads.
Regionserver thread will try to delete EphemeralNode and wait zk packet, but the sendThread has been not existed, so no one notify the regionserver thread.

"RegionServer:0;10.237.14.236,43311,1378958529812" prio=10 tid=0x00007f0a9d020000 nid=0x18db in Object.wait() [0x00007f0a8aa35000]
   java.lang.Thread.State: WAITING (on object monitor)
        at java.lang.Object.wait(Native Method)
        at java.lang.Object.wait(Object.java:485)
        at org.apache.zookeeper.ClientCnxn.submitRequest(ClientCnxn.java:1309)
        - locked <0x000000008ece3de8> (a org.apache.zookeeper.ClientCnxn$Packet)
        at org.apache.zookeeper.ZooKeeper.delete(ZooKeeper.java:866)
        at org.apache.hadoop.hbase.zookeeper.RecoverableZooKeeper.delete(RecoverableZooKeeper.java:127)
        at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1038)
        at org.apache.hadoop.hbase.zookeeper.ZKUtil.deleteNode(ZKUtil.java:1027)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.deleteMyEphemeralNode(HRegionServer.java:1073)
        at org.apache.hadoop.hbase.regionserver.HRegionServer.run(HRegionServer.java:851)
        at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.runRegionServer(MiniHBaseCluster.java:147)
        at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.access$000(MiniHBaseCluster.java:100)
        at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer$1.run(MiniHBaseCluster.java:131)
        at java.security.AccessController.doPrivileged(Native Method)
        at javax.security.auth.Subject.doAs(Subject.java:337)
        at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1340)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.hbase.util.Methods.call(Methods.java:37)
        at org.apache.hadoop.hbase.security.User.call(User.java:603)
        at org.apache.hadoop.hbase.security.User.access$700(User.java:50)
        at org.apache.hadoop.hbase.security.User$SecureHadoopUser.runAs(User.java:443)
        at org.apache.hadoop.hbase.MiniHBaseCluster$MiniHBaseClusterRegionServer.run(MiniHBaseCluster.java:129)

This situation emerges randomly. If i rerun the test, the tests may pass.