[BEAM-10590] BigQueryQueryToTableIT flaky: test_big_query_new_types

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Cannot Reproduce
• Fix Version/s: Missing
• Component/s: io-py-gcp, sdk-py-core
• Labels: flake flaky-test
• Assignee: Unassigned
• Reporter: Tyson Hamilton
• Created: 28/Jul/20 17:11
• Updated: 13/Jan/22 21:48
• Resolved: 18/May/21 22:30

Description

apache_beam.io.gcp.big_query_query_to_table_it_test.BigQueryQueryToTableIT.test_big_query_new_types is flaky. Similar to BEAM-7463 but creating a new issue instead of reopening t hat one. There are several recent failures, 3 non-matching checksums:

https://ci-beam.apache.org/job/beam_PostCommit_Python37/2628/testReport/junit/apache_beam.io.gcp.big_query_query_to_table_it_test/BigQueryQueryToTableIT/test_big_query_new_types_2/

https://ci-beam.apache.org/job/beam_PostCommit_Python37/2626/testReport/junit/apache_beam.io.gcp.big_query_query_to_table_it_test/BigQueryQueryToTableIT/test_big_query_new_types_native_2/

https://ci-beam.apache.org/job/beam_PostCommit_Python37/2624/testReport/junit/apache_beam.io.gcp.big_query_query_to_table_it_test/BigQueryQueryToTableIT/test_big_query_new_types_native/

 

an example stacktrace is:

File "/usr/lib/python3.7/unittest/case.py", line 59, in testPartExecutor
    yield
  File "/usr/lib/python3.7/unittest/case.py", line 615, in run
    testMethod()
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_it_test.py", line 263, in test_big_query_new_types
    big_query_query_to_table_pipeline.run_bq_pipeline(options)
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/io/gcp/big_query_query_to_table_pipeline.py", line 113, in run_bq_pipeline
    result = p.run()
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/testing/test_pipeline.py", line 112, in run
    False if self.not_use_test_runner_api else test_runner_api))
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/pipeline.py", line 521, in run
    allow_proto_holders=True).run(False)
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/pipeline.py", line 534, in run
    return self.runner.run_pipeline(self, self._options)
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/sdks/python/apache_beam/runners/direct/test_direct_runner.py", line 53, in run_pipeline
    hc_assert_that(self.result, pickler.loads(on_success_matcher))
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/build/gradleenv/1398941891/lib/python3.7/site-packages/hamcrest/core/assert_that.py", line 44, in assert_that
    _assert_match(actual=arg1, matcher=arg2, reason=arg3)
  File "/home/jenkins/jenkins-slave/workspace/beam_PostCommit_Python37/src/build/gradleenv/1398941891/lib/python3.7/site-packages/hamcrest/core/assert_that.py", line 60, in _assert_match
    raise AssertionError(description)Expected: (Test pipeline expected terminated in state: DONE and Expected checksum is 24de460c4d344a4b77ccc4cc1acb7b7ffc11a214)
     but: Expected checksum is 24de460c4d344a4b77ccc4cc1acb7b7ffc11a214 Actual checksum is da39a3ee5e6b4b0d3255bfef95601890afd80709