[YARN-2001] Threshold for RM to accept requests from AM after failover

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.6.0
• Component/s: resourcemanager
• Target Version/s: 2.6.0
• Hadoop Flags: Reviewed
• Assignee: Jian He
• Reporter: Jian He
• Created: 30/Apr/14 04:17
• Updated: 01/Dec/14 03:10
• Resolved: 18/Sep/14 18:15

Description

After failover, RM may require a certain threshold to determine whether it’s safe to make scheduling decisions and start accepting new container requests from AMs. The threshold could be a certain amount of nodes. i.e. RM waits until a certain amount of nodes joining before accepting new container requests. Or it could simply be a timeout, only after the timeout RM accepts new requests.
NMs joined after the threshold can be treated as new NMs and instructed to kill all its containers.

Issue Links

• relates to: YARN-2567 Add a percentage-node threshold for RM to wait for new allocations after restart/failover
• relates to: YARN-667 Data persisted in RM should be versioned