[BEAM-5758] Load tests for SyntheticSources in Python

• Type: Test
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Component/s: testing
• Assignee: Unassigned
• Reporter: Kasia Kucharczyk
• Created: 16/Oct/18 08:24
• Updated: 03/Jun/22 22:59

Description

For purpose of load testing the SyntheticSources there should be created tests with metrics which will be sent to BigQuery.

Issue Links

• is a parent of: BEAM-10672 Create Streaming Combine Python Load Test Jenkins Job
• relates to: BEAM-5777 Running ParDo in loop with DirectRunners raises RuntimeException
• relates to: BEAM-7536 Fix BigQuery dataset name in collecting Load Tests metrics
• links to: GitHub Pull Request #6239
• links to: GitHub Pull Request #8027

Sub-Tasks

• Create ParDo Load Test: Resolved
• Create Combine Load Test: Resolved
• Create CoGroupByKey Load Test: Resolved
• Create GroupByKey Load Test: Resolved
• Create SideInput Load test: Resolved
• Publish metrics from load tests to BigQuery database: Resolved
• Create Smoke and GBK Python Load Test Jenkins Job: Resolved
• GroupByKey uses data insertion pipeline in streaming tests: Resolved
• Remove runninig job twice: Resolved
• Create ParDo Python Load Test Jenkins Job: Resolved
• Create CoGBK Python Load Test Job Jenkins: Resolved
• Create Combine Python Load Test Jenkins Job: Resolved
• Create SideInput Python Load Test Jenkins Job: Resolved
• Implement missing pipeline parameters in ParDo Load Test: Resolved
• Create ParDo Python Load Test Jenkins Job [Flink]: Resolved
• Create CoGBK Python Load Test Jenkins Job [Flink]: Resolved
• Create Combine Python Load Test Jenkins Job [Flink]: Resolved
• Create SideInput Python Load Test Jenkins Job [Flink]: Open
• Add the rest of GBK tests in Jenkins job [Flink]: Resolved
• Simpler Flink cluster set up in load tests: Resolved
• Do not publish any metrics in Load tests on Flink: Resolved
• Upgrade supported Flink version to 1.9: Resolved
• Turn on metrics publishing in load tests on Flink: Resolved
• Migrate Python version to 3.7: Resolved
• Add stateful processing to ParDo load test: Resolved
• Bring back the names of the runtime metrics to "runtime": Resolved
• Create a common place for Load Tests configuration: Open
• Stop using nose in load tests: Resolved
• Include Dataflow Job ID in console output: Resolved
• Create Streaming ParDo Python Load Test Jenkins Job: Resolved
• Create Streaming coGBK Python Load Test Jenkins Job: Resolved
• Create Streaming GBK Python Load Test Jenkins Job: Resolved
• Create Streaming Combine Python Load Test Jenkins Job: Resolved