[YUNIKORN-3] Add scheduling metrics throughout the scheduling cycle

• Type: Improvement
• Status: Closed
• Priority: Critical
• Resolution: Implemented
• Fix Version/s: 0.11
• Component/s: core - common
• Assignee: Chenya Zhang
• Reporter: Wilfred Spiegelenburg
• Created: 19/Feb/20 14:04
• Updated: 21/Jan/22 22:16
• Resolved: 21/Dec/21 05:52

Description

The current metrics collection is limited to a small number of collections points.
We need to add metric collections through out the process.

See PR89 for details.

Sub-Tasks

• Add metrics implementation: "allocating_latency_seconds": Closed
• Add new metrics to monitor pending applications: "long_pending_app": Closed
• Align YuniKorn core's scheduler metrics with queue metrics for total applications accepted: Closed
• Refactor YuniKorn core's scheduler metrics for application submission: Closed
• Refactor YuniKorn core's scheduler metrics for container allocation: Closed
• Refactor YuniKorn core's scheduler metrics for application status: Closed