[HIVE-6468] HS2 & Metastore using SASL out of memory error when curl sends a get request

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.12.0, 0.13.0, 0.13.1, 0.14.0
• Fix Version/s: 1.0.0
• Component/s: HiveServer2, Metastore
• Labels: TODOC14

Environment

Centos 6.3, hive 12, hadoop-2.2

• Assignee: Navis Ryu
• Reporter: Abin Shahab
• Created: 20/Feb/14 00:06
• Updated: 19/Feb/15 18:21
• Resolved: 15/Dec/14 19:41

Description

We see an out of memory error when we run simple beeline calls.
(The hive.server2.transport.mode is binary)

curl localhost:10000

Exception in thread "pool-2-thread-8" java.lang.OutOfMemoryError: Java heap space
at org.apache.thrift.transport.TSaslTransport.receiveSaslMessage(TSaslTransport.java:181)
at org.apache.thrift.transport.TSaslServerTransport.handleSaslStartMessage(TSaslServerTransport.java:125)
at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:253)
at org.apache.thrift.transport.TSaslServerTransport.open(TSaslServerTransport.java:41)
at org.apache.thrift.transport.TSaslServerTransport$Factory.getTransport(TSaslServerTransport.java:216)
at org.apache.thrift.server.TThreadPoolServer$WorkerProcess.run(TThreadPoolServer.java:189)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:744)

Issue Links

• is related to: HIVE-8829 Upgrade to Thrift 0.9.2
• relates to: THRIFT-2660 Validate the bytes received in TSaslTransport
• relates to: THRIFT-2678 Make max message size configurable
• links to: Review Board