P1 Description
Currently, the only documentation regarding IO Performance Testing can be found here: https://beam.apache.org/documentation/io/testing/#i-o-transform-integration-tests. This is certainly not enough given that the performance testing framework currently allows to run tests:
- on local or hdfs filesystems
- on direct or dataflow runners
- manually using integrationTest task
- automatically using performanceTest task
- using pkb.py tool directly (PerfKitBenchmarker)
- on demand from pending Pull Requests
- detecting anomalies
- gathering results in dashboards
All the above bullets (and maybe others - to be investigated) need more explanation in the docs to make the Performance Testing Framework usable by the broader community.
Attachments
Issue Links
- links to
