[YARN-1493] Schedulers don't recognize apps separately from app-attempts

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.4.0
• Hadoop Flags: Reviewed
• Assignee: Jian He
• Reporter: Jian He
• Created: 11/Dec/13 05:14
• Updated: 10/Apr/14 13:11
• Resolved: 02/Jan/14 20:21

Description

Today, scheduler is tied to attempt only.

We need to separate app-level handling logic in scheduler. We can add new app-level events to the scheduler and separate the app-level logic out. This is good for work-preserving AM restart, RM restart, and also needed for differentiating app-level metrics and attempt-level metrics.

Issue Links

• blocks: YARN-1166 YARN 'appsFailed' metric should be of type 'counter'
• breaks: YARN-1577 Unmanaged AM is broken because of YARN-1493
• breaks: YARN-1689 RMAppAttempt is not killed when RMApp is at ACCEPTED
• is blocked by: YARN-1446 Change killing application to wait until state store is done