[HIVE-12250] Zookeeper connection leaks in Hive's HBaseHandler.

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 2.0.0
• Component/s: HiveServer2
• Assignee: Naveen Gangam
• Reporter: Naveen Gangam
• Created: 23/Oct/15 21:31
• Updated: 16/Feb/16 23:50
• Resolved: 27/Oct/15 18:10

Description

HiveServer2 performance regresses severely due to what appears to be a leak in the ZooKeeper connections. lsof output on the HS2 process shows about 8000 TCP connections to the ZK ensemble nodes.

grep TCP lsof-hive-node11 | grep node11 | grep -E "node03|node04|node05" | wc -l
7866
grep TCP lsof-hive-node11 | grep node11 | grep -E "node03" | wc -l
2615
grep TCP lsof-hive-node11 | grep node11 | grep -E "node04" | wc -l
2622
grep TCP lsof-hive-node11 | grep node11 | grep -E "node05" | wc -l
2629

node11 - HMS node
node03, node04 and node05 are the hosts for zookeeper ensemble.

Issue Links

• is depended upon by: HIVE-12418 HiveHBaseTableInputFormat.getRecordReader() causes Zookeeper connection leak.