[FLINK-21524] Improve the stability of scheduler benchmarks

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.13.0
• Fix Version/s: 1.13.0
• Component/s: Benchmarks, Runtime / Coordination
• Assignee: Zhilong Hong
• Reporter: Zhilong Hong
• Created: 01/Mar/21 03:14
• Updated: 09/Mar/21 05:49
• Resolved: 09/Mar/21 05:49

Description

Due to FLINK-21514, we find that when someone modifies interfaces and methods used by scheduler benchmarks, the compilation and execution of flink-benchmark may break. 

 

To improve the stability of scheduler benchmarks, we decide to replace scheduler benchmarks with wrapper/executor classes, and move the current implementations to the flink repository. Also we'll implement several unit tests based on the implementations. In this way, when someone modifies interfaces and methods used by scheduler benchmarks, the unit tests fails, and then they must fix the broken benchmarks. 

Issue Links

• is related to: FLINK-21658 Align flink-benchmarks with job graph builder
• is related to: FLINK-21514 26.02.2021 Benchmarks are not compiling
• is related to: FLINK-21625 5.03.2021 Benchmarks are not compiling