[MAPREDUCE-4662] JobHistoryFilesManager thread pool never expands

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.0.2
• Fix Version/s: 1.2.0
• Component/s: jobhistoryserver
• Target Version/s: 1.2.0
• Assignee: Kihwal Lee
• Reporter: Thomas Graves
• Created: 18/Sep/12 16:04
• Updated: 16/Dec/14 20:15
• Resolved: 25/Sep/12 14:39

Description

The job history file manager creates a threadpool with core size 1 thread, max pool size 3. It never goes beyond 1 thread though because its using a LinkedBlockingQueue which doesn't have a max size.

void start()

{ executor = new ThreadPoolExecutor(1, 3, 1, TimeUnit.HOURS, new LinkedBlockingQueue<Runnable>()); }

According to the ThreadPoolExecutor java doc page it only increases the number of threads when the queue is full. Since the queue we are using has no max size it never fills up and we never get more then 1 thread.

Issue Links

• is related to: YARN-2972 DelegationTokenRenewer thread pool never expands