[HIVE-5229] Better thread management for HiveServer2 async threads

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.12.0, 0.13.0
• Fix Version/s: 0.13.0
• Component/s: HiveServer2
• Assignee: Vaibhav Gumashta
• Reporter: Vaibhav Gumashta
• Created: 05/Sep/13 18:58
• Updated: 30/Jun/14 01:36
• Resolved: 09/Nov/13 07:24

Description

HIVE-4617 provides support for async execution in HS2. The async (background) thread pool currently creates N threads (server config), which are alive all the time. If all the threads in the pool are busy, a new request is added to a blocking queue. However, we can improve the strategy by not having all the async (background) threads alive when there are no corresponding requests. The async threads should die after a certain timeout if there are no new requests to handle.

Issue Links

• blocks: HIVE-5232 Make JDBC use the new HiveServer2 async execution API by default
• is blocked by: HIVE-4617 Asynchronous execution in HiveServer2 to run a query in non-blocking mode