[YUNIKORN-842] [Umbrella] YuniKorn performance tuning and benchmark

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.1
• Component/s: core - scheduler, shim - kubernetes
• Target Version: 0.12.1
• Assignee: TingYao Huang
• Reporter: Weiwei Yang
• Created: 08/Sep/21 05:35
• Updated: 05/Sep/23 16:35
• Resolved: 10/Dec/21 17:57

Description

http://yunikorn.apache.org/docs/next/performance/evaluate_perf_function_with_kubemark is a bit out-of-dated, we want to reveal the performance benchmark with the latest codebase. With this effort, we want to ellivate possible bottleneck and further improve the throughput and performance. In this process, we will also further improve the metrics system.

Sub-Tasks

• Prepare servers and hardware for benchmark work: Closed
• Kubemark build, setup and configuration: Closed
• Publish benchmark result on web-site: Closed
• Documents of build kubemark and prometheus: Closed
• Add an another latency metrics to measure tryNode() latency: Closed
• Fix scheduling latency metrics: Closed
• Fix the scheduling latency metrics: Closed
• Add document to explain existing yunikorn metrics: Closed