[YARN-2972] DelegationTokenRenewer thread pool never expands

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.7.0
• Component/s: resourcemanager
• Target Version/s: 2.7.0
• Hadoop Flags: Reviewed
• Assignee: Jason Darrell Lowe
• Reporter: Jason Darrell Lowe
• Created: 16/Dec/14 20:12
• Updated: 10/Apr/15 20:10
• Resolved: 18/Dec/14 01:34

Description

DelegationTokenRenewer uses a thread pool to manage token renewals. The number of threads is configurable, but unfortunately the pool never expands beyond the hardcoded initial 5 threads because we are using an unbounded LinkedBlockingQueue. ThreadPoolExecutor only grows the thread pool beyond the core size when the specified queue is full.

Issue Links

• relates to: MAPREDUCE-4662 JobHistoryFilesManager thread pool never expands