[HBASE-19443] HBase Client gets stuck - Cannot get replica 0 location for...

• Type: Bug
• Status: Resolved
• Priority: Critical
• Resolution: Not A Problem
• Affects Version/s: 1.2.4
• Flags: Important
• Assignee: Unassigned
• Reporter: Lakshmiprasad D
• Created: 06/Dec/17 19:10
• Updated: 01/Aug/18 06:23
• Resolved: 23/Jan/18 05:11

Description

When the loader is loading data to HBase, without any forewarning that client gets stuck and prints the below message continuously:

[ERROR] AsyncProcess[hconnection-0x71f5455a-shared--pool20-t40846] Cannot get replica 0 location for {"totalColumns":20,"families":{"v":[

{"timestamp":1512584999999,"tag":[],"qualifier":"0","vlen":4}

,

{"timestamp":1512584999999,"tag":[],"qualifier":"uid","vlen":8}

,

{"timestamp":1512584999999,"tag":[],"qualifier":"1","vlen":8}

,

{"timestamp":1512584999999,"tag":[],"qualifier":"2","vlen":11}

]},"row":"C\\x99L[5\\x80\\x00
x00"}

At this time no other loaders are impacted. Restart of the loader seems to solve the issue until next occurence.

Upon doing jstack at this time on the loader, it is observed that process is stuck on a object monitor inside 'AsyncProcess.java' class.