[YARN-3999] RM hangs on draining events

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.6.1, 2.8.0, 2.7.2, 3.0.0-alpha1
• Labels: 2.6.1-candidate
• Target Version/s: 2.7.2
• Assignee: Jian He
• Reporter: Jian He
• Created: 30/Jul/15 18:50
• Updated: 06/Jan/17 00:58
• Resolved: 12/Aug/15 01:28

Description

If external systems like ATS, or ZK becomes very slow, draining all the events take a lot of time. If this time becomes larger than 10 mins, all applications will expire. Fixes include:
1. add a timeout and stop the dispatcher even if not all events are drained.
2. Move ATS service out from RM active service so that RM doesn't need to wait for ATS to flush the events when transitioning to standby.
3. Stop client-facing services (ClientRMService etc.) first so that clients get fast notification that RM is stopping/transitioning.

Issue Links

• is related to: YARN-4153 TestAsyncDispatcher failed at branch-2.7