[FLINK-21731] Add benchmarks for DefaultScheduler's creation, scheduling and deploying

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.13.0
• Fix Version/s: 1.13.0
• Component/s: Benchmarks, Runtime / Coordination
• Labels: pull-request-available
• Assignee: Zhilong Hong
• Reporter: Zhilong Hong
• Created: 11/Mar/21 07:43
• Updated: 23/Sep/21 18:03
• Resolved: 28/Mar/21 06:31

Description

We notice that DefaultScheduler#allocateSlotsAndDeploy is not covered in the current scheduler benchmark. When we are trying to implement a benchmark related to this procedure, we think that it's better to implement a benchmark that covers the entire procedures of DefaultScheduler's creation, scheduling and deploying instead.

This can avoid missing any parts that may affect the performance of scheduling. Also in this way we don't need to add benchmarks for every sub-procedure related to scheduling, which makes the benchmark heavy and hard to maintain. Then we can just focus on the performance-sensitive procedures, as the existing benchmarks do.

The new benchmark items are implemented based on DefaultSchedulerBatchSchedulingTest.

Issue Links

• is related to: FLINK-20612 Add benchmarks for scheduler
• relates to: FLINK-21975 Remove hamcrest dependency from SchedulerBenchmarkBase
• links to: GitHub Pull Request #11
• links to: GitHub Pull Request #15148