[BEAM-8941] Create a common place for Load Tests configuration

• Type: Sub-task
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Fix Version/s: Not applicable
• Component/s: testing
• Assignee: Unassigned
• Reporter: Kamil Wasilewski
• Created: 10/Dec/19 18:12
• Updated: 03/Jun/22 22:59

Description

The Apache Beam community maintains different versions of each Load Test. For example, right now, there are two versions of all Python Load Tests: the first one runs on Dataflow runner, and the second one runs on Flink. With the lack of a common place where configuration for the tests can be stored, the configuration is duplicated many times with minimal differences.

The goal is to create a common place for the configuration, so that it could be passed to different files with tests (.test-infra/jenkins/*.groovy) and filtered according to needs.

Issue Links

• links to: GitHub Pull Request #10543