[HBASE-24506] async client deadlock

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha-1, 2.3.0, 2.2.4, 2.4.0, 2.2.5
• Fix Version/s: 3.0.0-alpha-1, 2.3.0, 2.2.6
• Component/s: asyncclient
• Hadoop Flags: Reviewed
• Assignee: Duo Zhang
• Reporter: Whitney Jackson
• Created: 05/Jun/20 00:34
• Updated: 08/Jun/20 22:49
• Resolved: 08/Jun/20 02:21

Description

I ran into an issue where one instance in a cluster of application servers backed by HBase stopped processing requests. Looking at a thread dump, it seems HBase client threads are deadlocked:

https://pastebin.com/raw/B3FJL1Ag

The deadlock seemed to happen at the same time that a region server was abruptly stopped (the physical server was restarted unexpectedly).

I'm using the hbase async API. The hbase client version is 2.2.4. The server is running 2.2.4 as well.

Issue Links

• links to: GitHub Pull Request #1858