[YARN-261] Ability to fail AM attempts

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.3-alpha
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: api
• Target Version/s: 2.8.0
• Hadoop Flags: Reviewed
• Assignee: Rohith Sharma K S
• Reporter: Jason Darrell Lowe
• Created: 05/Dec/12 22:31
• Updated: 30/Aug/16 01:32
• Resolved: 09/Oct/15 14:22

Description

It would be nice if clients could ask for an AM attempt to be killed. This is analogous to the task attempt kill support provided by MapReduce.

This feature would be useful in a scenario where AM retries are enabled, the AM supports recovery, and a particular AM attempt is stuck. Currently if this occurs the user's only recourse is to kill the entire application, requiring them to resubmit a new application and potentially breaking downstream dependent jobs if it's part of a bigger workflow. Killing the attempt would allow a new attempt to be started by the RM without killing the entire application, and if the AM supports recovery it could potentially save a lot of work. It could also be useful in workflow scenarios where the failure of the entire application kills the workflow, but the ability to kill an attempt can keep the workflow going if the subsequent attempt succeeds.

Issue Links

• breaks: YARN-4294 [JDK8] Fix javadoc errors caused by wrong reference and illegal tag
• is blocked by: YARN-891 Store completed application information in RM state store