[TEZ-1187] Add a framework ExecutorService which shares threads.

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Assignee: Harish JP
• Reporter: Siddharth Seth
• Created: 06/Jun/14 22:59
• Updated: 22/Aug/17 00:03
• Resolved: 20/Apr/17 09:19

Description

Thread pools are used all over for fetchers, sort etc. When running a single task - this is already a problem, and gets worse when running multiple tasks.

Issue Links

• breaks: TEZ-3695 TestTezSharedExecutor fails sporadically
• is blocked by: TEZ-1940 Change OrderedGroupedFetcher to work with a ThreadPool and Callables
• is blocked by: TEZ-2454 Change FetcherOrderedGroup to work as Callables instead of blocking threads
• relates to: TEZ-1195 Remove manual Thread creation from DAGAppMaster and all supporting classes in favor of shared and managed Thread pool (e.g., ExecutorService)