[BEAM-9829] Restructure test infrastructure for Python SDK

• Type: Task
• Status: Triage Needed
• Priority: P3
• Resolution: Unresolved
• Component/s: sdk-py-core, testing
• Assignee: Unassigned
• Reporter: yoshiki obata
• Created: 27/Apr/20 15:27
• Updated: 25/Jul/22 13:59

Description

We need to support newer Python versions like 3.8, 3.9 continuously.
But maintaining test for all versions costs us much in point of development and test resources.
So we should reconsider test infrastructure about following points;

• how to prioritize Python versions and tests to be tested frequently, and vice versa
• how to switch easily which versions to have high priority

detail discussion is here:
https://lists.apache.org/thread.html/rd070afcebff5c967ec3b25d1f7a77db5278992c1508082bf5f636acd%40%3Cdev.beam.apache.org%3E

Issue Links

• is related to: BEAM-8494 Python 3.8 Support

Sub-Tasks

• Reduce the code duplication across beam/sdks/python/test-suites/$runner/py3*: Resolved
• Priotize Python versions for PreCommit/PostCommit tests: In Progress
• Reduce PreCommit test to the minimum and move rest of them to PostCommit one: Open
• Do not hardcode Python versions in test suites, instead make it configurable.: In Progress