[HBASE-12951] TestHCM.testConnectionClose is flakey when using AsyncRpcClient as client implementation

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0, 2.0.0
• Fix Version/s: 1.1.0, 2.0.0
• Component/s: IPC/RPC
• Hadoop Flags: Reviewed
• Assignee: Duo Zhang
• Reporter: Duo Zhang
• Created: 02/Feb/15 03:14
• Updated: 03/Jun/15 15:29
• Resolved: 02/Feb/15 16:31

Description

Sometimes the background thread is stuck in table.get, here is the jstack result.

"testConnectionCloseThread" prio=10 tid=0x00007fdb296f9800 nid=0x6b5c in Object.wait() [0x00007fdad1bf9000]
java.lang.Thread.State: WAITING (on object monitor)
at java.lang.Object.wait(Native Method)

• waiting on <0x00000000f192d6e0> (a org.apache.hadoop.hbase.ipc.AsyncCall)
  at java.lang.Object.wait(Object.java:503)
  at io.netty.util.concurrent.DefaultPromise.await(DefaultPromise.java:254)
• locked <0x00000000f192d6e0> (a org.apache.hadoop.hbase.ipc.AsyncCall)
  at io.netty.util.concurrent.DefaultPromise.await(DefaultPromise.java:32)
  at io.netty.util.concurrent.AbstractFuture.get(AbstractFuture.java:31)
  at org.apache.hadoop.hbase.ipc.AsyncRpcClient.call(AsyncRpcClient.java:181)
  at org.apache.hadoop.hbase.ipc.AbstractRpcClient.callBlockingMethod(AbstractRpcClient.java:213)
  at org.apache.hadoop.hbase.ipc.AbstractRpcClient$BlockingRpcChannelImplementation.callBlockingMethod(AbstractRpcClient.java:287)
  at org.apache.hadoop.hbase.protobuf.generated.ClientProtos$ClientService$BlockingStub.get(ClientProtos.java:31727)
  at org.apache.hadoop.hbase.client.HTable$4.call(HTable.java:848)
  at org.apache.hadoop.hbase.client.HTable$4.call(HTable.java:1)
  at org.apache.hadoop.hbase.client.RpcRetryingCallerImpl.callWithRetries(RpcRetryingCallerImpl.java:120)
  at org.apache.hadoop.hbase.client.HTable.get(HTable.java:856)
  at org.apache.hadoop.hbase.client.TestHCM$3.run(TestHCM.java:371)