[BEAM-8193] Python PostCommit Tests are Flaky

• Type: Bug
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Fix Version/s: Not applicable
• Component/s: sdk-py-core, testing
• Assignee: Unassigned
• Reporter: Ahmet Altay
• Created: 10/Sep/19 18:23
• Updated: 04/Jun/22 13:52

Description

I will use this as an umbrella bug, create sub task and assign to folks working on Python in general. I will try to do a round-robin assignment.

The goal is to improve stability of Py2, 3.5, 3.6, 3.7 postcommits to be working >80% of the time [1].

/cc (you might get issues assigned) pabloem udim chamikara tvalentyn

[1] http://104.154.241.245/d/McTAiu0ik/stability-critical-jobs-status?orgId=1

Sub-Tasks

• virtualSetupEnv task is flaky: Resolved
• Quota exceeded for create requests: Resolved
• Python Post Commit 3.6 issue: Resolved
• Python 3.{5,7} post commit timed out at 100 minutes: Resolved
• test_big_query_write_without_schema might be flaky?: Resolved
• Python pre-commits need to include python 3.x tests: Resolved
• Run Portable_Python PreCommit fails with pickling: Resolved
• Use persistent caching with pip: Open
• Py2 post-commit test crossLanguagePortableWordCount failing: Resolved
• ZipFileArtifactServiceTest.test_concurrent_requests flaky: Resolved
• docker-credential-gcloud missing: Resolved
• test_streaming_pipeline_returns_expected_user_metrics_fnapi_it test flaky: Resolved
• installGcpTest task is flaky: Resolved
• Consistently timing out: BigQueryStreamingInsertTransformIntegrationTests.test_multiple_destinations_transform: Resolved
• BigQueryQueryToTableIT.test_big_query_legacy_sql - fails in post commit tests: Resolved
• portableWordCount Flink/Spark - flaky post commits: Resolved
• sparkValidatesRunner - python post commit flaky: Resolved
• BigQueryWriteIntegrationTests.test_big_query_write_without_schema - flaky post commit: Resolved
• beam_PostCommit_Py_VR_Dataflow is timing out: Resolved
• PreCommit_Python2_PVR_Flink_Commit flaky: Resolved
• beam_PostCommit_Py_ValCont should run with dataflow_worker_jar: Open