Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-12653

Dataflow validatesRunnerV2TestStreaming broken due to very flaky containers

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: P1
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: sdk-java-core
    • Labels:
      None

      Description

      https://ci-beam.apache.org/job/beam_PostCommit_Java_VR_Dataflow_V2_Streaming/1013/
      https://scans.gradle.com/s/6722dp7wsep2o

      java.lang.RuntimeException: A worker was unable to start up.  Error: Unable to pull container image due to error: image pull request failed with error: Error response from daemon: manifest for us.gcr.io/apache-beam-testing/java-postcommit-it/java:20210722060103 not found: manifest unknown: Failed to fetch "20210722060103" from request "/v2/apache-beam-testing/java-postcommit-it/java/manifests/20210722060103".. This is likely due to an invalid SDK container image URL. Please verify any provided SDK container image is valid and that Dataflow workers have permissions to pull image.	
      at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:141)	
      at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:93)	
      at org.apache.beam.runners.dataflow.TestDataflowRunner.run(TestDataflowRunner.java:55)	
      at org.apache.beam.sdk.Pipeline.run(Pipeline.java:323)	
      at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:398)	
      at org.apache.beam.sdk.testing.TestPipeline.run(TestPipeline.java:334)	
      at org.apache.beam.sdk.transforms.CombineTest$SharedTestBase.runTestBasicCombine(CombineTest.java:138)	
      at org.apache.beam.sdk.transforms.CombineTest$BasicTests.testBasicCombineEmpty(CombineTest.java:686)	
      •••
      at org.apache.beam.sdk.testing.TestPipeline$1.evaluate(TestPipeline.java:322)	
      •••
      

      Possibly related to https://github.com/apache/beam/commit/31c2b76710f863c54da79ac9f34e6a76ebaabbeb or possibly just really flaky?

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                emilymye Emily Ye
                Reporter:
                apilloud Andrew Pilloud
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 40m
                  1h 40m