[BEAM-12653] Dataflow validatesRunnerV2TestStreaming broken due to very flaky containers

• Type: Bug
• Status: Resolved
• Priority: P1
• Resolution: Fixed
• Fix Version/s: Missing
• Component/s: sdk-java-core
• Assignee: Emily Ye
• Reporter: Andrew Pilloud
• Created: 22/Jul/21 23:26
• Updated: 13/Jan/22 21:49
• Resolved: 28/Jul/21 20:05

Description

https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/1013/
https://scans.gradle.com/s/6722dp7wsep2o

java.lang.RuntimeException: A worker was unable to start up.  Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210722060103 not found: manifest unknown: Failed to fetch "20210722060103" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20210722060103".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.	
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:141)	
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:93)	
at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55)	
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:323)	
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:398)	
at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:334)	
at org.apache.beam.sdk.transforms.CombineTest$SharedTestBase.runTestBasicCombine(CombineTest.java:138)	
at org.apache.beam.sdk.transforms.CombineTest$BasicTests.testBasicCombineEmpty(CombineTest.java:686)	
•••
at org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:322)	
•••

Possibly related to https://github.com/apache/beam/commit/31c2b76710f863c54da79ac9f34e6a76ebaabbeb or possibly just really flaky?

Issue Links

• links to: GitHub Pull Request #15213