[YUNIKORN-940] Periodic & on-demand state dump in Yunikorn

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.1
• Component/s: core - scheduler
• Labels: pull-request-available
• Assignee: Peter Bacsko
• Reporter: Peter Bacsko
• Created: 09/Nov/21 10:55
• Updated: 19/Dec/22 10:10
• Resolved: 16/Nov/21 15:03

Description

Currently, there are many REST endpoints in Yunikorn which provide a bunch of useful information about applications, nodes, node utilization, etc.

However, it requires many round trips to retrieve all of these. Also, it is often beneficial to periodically log detailed state information.

The scope of this ticket is:

• Introduce new REST endpoint which collects and returns all info which is currently available separately
• Refactor code (extract DAO generating methods)
• Add new REST endpoints which enables/disables periodic state logging

Issue Links

• is depended upon by: YUNIKORN-943 Document new state dump features introduced in YUNIKORN-940
• is related to: YUNIKORN-945 state dump testing improvements
• relates to: YUNIKORN-950 Add missing HTTP routes regarding statedump feature
• relates to: YUNIKORN-949 Location of the state dump file should be configurable
• relates to: YUNIKORN-1483 Overhaul periodic state dump support
• links to: GitHub Pull Request #336