[BEAM-7679] examples.complete.game ITs might use the same BQ dataset

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: test-failures
• Assignee: Udi Meiri
• Reporter: Udi Meiri
• Created: 03/Jul/19 00:17
• Updated: 16/May/20 14:03
• Resolved: 24/Jul/19 21:08

Description

Code is:

unique_dataset_name = dataset_base_name + str(int(time.time()))

https://github.com/apache/beam/blob/932e802279a2daa0ff7797a8fc81e952a4e4f252/sdks/python/apache_beam/io/gcp/tests/utils.py#L59

 

Example log: https://builds.apache.org/job/beam_PostCommit_Python3_Verify_PR/476/consoleFull

I suspect this issue because of this error:

google.api_core.exceptions.NotFound: 404 Not found: Table apache-beam-testing:leader_board_it_dataset1562016299.leader_board_teams was not found in location US

and the fact that a lot of such tests started at the same second.

Issue Links

• links to: GitHub Pull Request #8991