[BEAM-10828] Python postcommits failing (Compute Engine API has not fully initialized)

• Type: Bug
• Status: Resolved
• Priority: P1
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: test-failures
• Labels: currently-failing
• Assignee: Kyle Weaver
• Reporter: Kyle Weaver
• Created: 27/Aug/20 23:56
• Updated: 13/May/21 22:58
• Resolved: 13/May/21 22:58

Description

A number of Dataflow jobs are failing with errors like:

Workflow failed. Causes: The Compute Engine API has not fully initialized. Please try again in a few minutes., Unable to get information for region us-central1.

Or:

Workflow failed. Causes: The Compute Engine API has not fully initialized. Please try again in a few minutes., Unable to get GCE information for project apache-beam-testing.

It does not seem to be deterministic, or limited to any subset of tests or Jenkins machines.

For example: https://ci-beam.apache.org/job/beam_PostCommit_Python37/2763/testReport/junit/apache_beam.io.gcp.datastore.v1new.datastore_write_it_test/DatastoreWriteIT/test_datastore_write_limit/

Issue Links

• relates to: BEAM-10717 beam_PostCommit_Java failing: GCE unable to get machine info due to lack of permissions