[HIVE-7081] HiveServer/HiveServer2 leaks jdbc connections when network interrupt

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.12.0, 0.13.0
• Component/s: HiveServer2, JDBC
• Labels: ConnectoinLeak HiveServer2 JDBC

Environment

hadoop 1.2.1
hive 0.12.0 / hive 0.13.0
linux 2.6.32

• Assignee: Unassigned
• Reporter: Wang Zhiqiang
• Created: 17/May/14 03:18
• Updated: 18/Dec/14 17:52

Description

HiveServer/HiveServer2 leaks jdbc connections when network between client and server is interrupted。
I test both use DBVisualizer and write JDBC code，when the network between client and hiveserver/hiverserver2 is interrupted，the tcp connection in the server side will be in ESTABLISH state forever util the server is stoped。By Using jstack to print out server's thread, I found thread is doing socketRead0()。

"pool-1-thread-13" prio=10 tid=0x00007fd00c0c6800 nid=0x5d21 runnable [0x00007fd000180000]
java.lang.Thread.State: RUNNABLE
at java.net.SocketInputStream.socketRead0(Native Method)
at java.net.SocketInputStream.read(SocketInputStream.java:152)
at java.net.SocketInputStream.read(SocketInputStream.java:122)
at java.io.BufferedInputStream.fill(BufferedInputStream.java:235)
at java.io.BufferedInputStream.read1(BufferedInputStream.java:275)
at java.io.BufferedInputStream.read(BufferedInputStream.java:334)

• locked <0x00000000ebc24f28> (a java.io.BufferedInputStream)
  at org.apache.thrift.transport.TIOStreamTransport.read(TIOStreamTransport.java:127)
  at org.apache.thrift.transport.TTransport.readAll(TTransport.java:84)
  at org.apache.thrift.protocol.TBinaryProtocol.readAll(TBinaryProtocol.java:378)
  at org.apache.thrift.protocol.TBinaryProtocol.readI32(TBinaryProtocol.java:297)
  at org.apache.thrift.protocol.TBinaryProtocol.readMessageBegin(TBinaryProtocol.java:204)
  at org.apache.thrift.TBaseProcessor.process(TBaseProcessor.java:27)
  at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:206)
  at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
  at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
  at java.lang.Thread.run(Thread.java:745)

Issue Links

• is related to: HIVE-6679 HiveServer2 should support configurable the server side socket timeout and keepalive for various transports types where applicable
• relates to: HIVE-5799 session/operation timeout for hiveserver2