[YARN-1489] [Umbrella] Work-preserving ApplicationMaster restart

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Assignee: Unassigned
• Reporter: Vinod Kumar Vavilapalli
• Created: 10/Dec/13 22:56
• Updated: 08/Apr/18 21:09
• Resolved: 08/Apr/18 21:09

Description

Today if AMs go down,

• RM kills all the containers of that ApplicationAttempt
• New ApplicationAttempt doesn't know where the previous containers are running
• Old running containers don't know where the new AM is running.

We need to fix this to enable work-preserving AM restart. The later two potentially can be done at the app level, but it is good to have a common solution for all apps where-ever possible.

Issue Links

• incorporates: YARN-4758 Enable discovery of AMs by containers
• is depended upon by: YARN-896 Roll up for long-lived services in YARN
• is related to: MAPREDUCE-6608 Work Preserving AM Restart for MapReduce
• relates to: TWILL-256 Support fault tolerant AM restart

Sub-Tasks

• RM should optionally not kill all containers when an ApplicationMaster exits: Closed
• Protocol changes for RM to bind and notify a restarted AM of existing containers: Closed
• Fix app specific scheduler-events' names to be app-attempt based: Closed
• Schedulers don't recognize apps separately from app-attempts: Closed
• Change distributed-shell to retain containers from previous AppAttempt: Closed
• Unmanaged AM is broken because of YARN-1493: Closed
• Rebind NM tokens for previous attempt's running containers to the new attempt: Closed
• Add work preserving restart support for Unmanaged AMs: Resolved
• Revisit how AMs learn of containers from previous attempts: Open
• Slider AM fails to restart: NPE in RegisterApplicationMasterResponseProto$Builder.addAllNmTokensFromPreviousAttempts: Closed
• DistributedShell may allocate more containers than client specified after it restarts: Closed
• Wrong NMToken is issued when NM preserving restarts with containers running: Closed
• Stale token used by restarted AM (with previous containers retained) to request new container: Closed