[YUNIKORN-29] Add integration testing tools to generate function/performance reports

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.1
• Component/s: release
• Labels: pull-request-available
• Assignee: Tao Yang
• Reporter: Tao Yang
• Created: 10/Mar/20 13:55
• Updated: 06/Feb/22 12:08
• Resolved: 19/Nov/21 17:58

Description

This issue aims at adding integration testing tools which can be used to do function or performance tests for common schedulers on K8S, and also support specific test cases for yunikorn scheduler.

Common Test Cases for schedulers on K8s:

• Throughput
  Request a certain number of pods via different schedulers and then record the distributions of scheduled pods, draw results of different schedulers on the same chart.
• Node Fairness
  Request a certain number of pods via different schedulers and then record the distributions of node usage, draw results on charts separately for different schedulers.

Test cases for YuniKorn scheduler:

• Queue Fairness
  Prepare queues with different capacities, request pods with different number or resource for these queues, then record the usage of queues, draw results on the same chart.

 

Discuss: https://docs.google.com/document/d/17NmLvN8JC9Z5TW8BEChMg9VzPJwvZYa6pc_2gAXiXqE/edit?ts=5ea7b780

Issue Links

• is related to: YUNIKORN-951 Add perf-tool description into benchmarking tutorial page
• links to: GitHub Pull Request #49