[BEAM-8742] Add stateful processing to ParDo load test

• Type: Sub-task
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.22.0
• Component/s: testing
• Assignee: Maximilian Michels
• Reporter: Maximilian Michels
• Created: 19/Nov/19 17:38
• Updated: 24/Aug/20 13:30
• Resolved: 07/May/20 16:07

Description

So far, the ParDo load test is not stateful. We should add a basic counter to test the stateful processing.

The test should work in streaming mode and with checkpointing.

Issue Links

• is related to: BEAM-9981 Use FlinkRunner instead of PortableRunner for load tests
• is related to: BEAM-9963 Flink streaming load tests fail with TypeError
• relates to: BEAM-9966 Investigate variance in checkpoint duration of ParDo streaming tests
• links to: GitHub Pull Request #10157
• links to: GitHub Pull Request #11558