[HIVE-23458] Introduce unified thread pool for scheduled jobs

• Type: Improvement
• Status: Patch Available
• Priority: Major
• Resolution: Unresolved
• Component/s: HiveServer2
• Labels: pull-request-available todoc4.0
• Assignee: Eugene Chung
• Reporter: Eugene Chung
• Created: 13/May/20 06:58
• Updated: 21/Oct/22 07:31

Description

As I mentioned in the comment of HIVE-23164, I've made the unified scheduled executor service like org.apache.hadoop.hive.metastore.ThreadPool.

I think it could help
1. to minimize the possibility of making non-daemon threads when developers need ScheduledExecutorService
2. to achieve the utilization of server resources because the current situation is all of the modules make its own ScheduledExecutorService and all of the threads are just using for one job.
3. administrators of Hive servers by providing hive.exec.scheduler.num.threads configuration so that they can predict and set how many threads are used and needed.

Issue Links

• is related to: HIVE-23164 Server is not properly terminated because of non-daemon threads
• links to: GitHub Pull Request #1919