[BEAM-9980] Do not hardcode Python versions in test suites, instead make it configurable.

• Type: Sub-task
• Status: In Progress
• Priority: P3
• Resolution: Unresolved
• Component/s: sdk-py-core
• Assignee: Unassigned
• Reporter: yoshiki obata
• Created: 13/May/20 13:42
• Updated: 04/Jun/22 16:16

Description

We have some tests that we run only under specific Python versions,

• FlinkValidatesRunner test runs using Python 3.5
• HDFS Python 3 tests are running only with Python 3.7
• Cross-language Py3 tests for Spark are running under Python 3.5
  etc...

Python versions to run them under need to be switchable.

Issue Links

• Blocked: BEAM-9944 Reduce PreCommit test to the minimum and move rest of them to PostCommit one
• blocks: BEAM-9943 Priotize Python versions for PreCommit/PostCommit tests
• is blocked by: BEAM-7774 Stop usign Perfkit Benchmarker tool in Python performance tests
• is blocked by: BEAM-9785 Add PostCommit suite for Python 3.8
• is blocked by: BEAM-9810 Add a Tox (precommit) suite for Python 3.8
• links to: GitHub Pull Request #12239
• links to: GitHub Pull Request #12614
• links to: GitHub Pull Request #13242
• links to: GitHub Pull Request #13316
• links to: GitHub Pull Request #13330
• links to: GitHub Pull Request #13334
• links to: GitHub Pull Request #13349
• links to: GitHub Pull Request #13382
• links to: GitHub Pull Request #13412
• links to: GitHub Pull Request #13424
• links to: GitHub Pull Request #13426
• links to: GitHub Pull Request #13460
• links to: GitHub Pull Request #13461
• links to: GitHub Pull Request #13624