[YARN-4091] Add REST API to retrieve scheduler activity

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.0
• Fix Version/s: 2.9.0, 3.0.0-alpha1
• Component/s: capacity scheduler, resourcemanager
• Hadoop Flags: Reviewed
• Assignee: Chen Ge
• Reporter: Sunil G
• Created: 27/Aug/15 18:03
• Updated: 14/Oct/19 15:38
• Resolved: 15/Sep/16 21:50

Description

As schedulers are improved with various new capabilities, more configurations which tunes the schedulers starts to take actions such as limit assigning containers to an application, or introduce delay to allocate container etc.
There are no clear information passed down from scheduler to outerworld under these various scenarios. This makes debugging very tougher.

This ticket is an effort to introduce more defined states on various parts in scheduler where it skips/rejects container assignment, activate application etc. Such information will help user to know whats happening in scheduler.

Attaching a short proposal for initial discussion. We would like to improve on this as we discuss.

Issue Links

• blocks: YARN-5452 [YARN-3368] Support scheduler activities in new YARN UI
• is related to: YARN-3946 Update exact reason as to why a submitted app is in ACCEPTED state to app's diagnostic message