[HIVE-7021] HiveServer2 memory leak on failed queries

• Type: Bug
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.12.0
• Component/s: HiveServer2
• Assignee: Naveen Gangam
• Reporter: Naveen Gangam
• Created: 06/May/14 19:36
• Updated: 03/Mar/15 12:17

Description

The number of the following objects keeps increasing if a query causes an exception:
org.apache.hive.service.cli.HandleIdentifier
org.apache.hive.service.cli.OperationHandle
org.apache.hive.service.cli.log.LinkedStringBuffer
org.apache.hive.service.cli.log.OperationLog

The leak can be observed using a JDBCClient that runs something like this
connection = DriverManager.getConnection("jdbc:hive2://" + hostname + ":10000/default", "", "");
statement = connection.createStatement();
statement.execute("CREATE TEMPORARY FUNCTION dummy_function AS 'dummy.class.name'");

The above SQL will fail if HS2 cannot load "dummy.class.name" class. Each iteration of such query will result in +1 increase in instance count for the classes mentioned above.

This will eventually cause OOM in the HS2 service.

Issue Links

• relates to: HIVE-9839 HiveServer2 leaks OperationHandle on async queries which fail at compile phase