[BEAM-3028] DatastoreIO integration tests failing on Dataflow

• Type: Bug
• Status: Resolved
• Priority: P0
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.2.0
• Component/s: runner-dataflow
• Assignee: Chamikara Madhusanka Jayalath
• Reporter: Kenneth Knowles
• Created: 06/Oct/17 20:20
• Updated: 16/May/20 14:20
• Resolved: 09/Oct/17 22:19

Description

Our testing signal has been bad enough that we seemed to have ignored or missed this when it happened.

From these builds: (while the logs last, you can check them)

https://builds.apache.org/job/beam_PostCommit_Java_MavenInstall/4963/org.apache.beam$beam-runners-google-cloud-dataflow-java/testReport/junit/org.apache.beam.sdk.io.gcp.datastore/V1ReadIT/testE2EV1Read/
https://builds.apache.org/job/beam_PostCommit_Java_MavenInstall/4963/org.apache.beam$beam-runners-google-cloud-dataflow-java/testReport/junit/org.apache.beam.sdk.io.gcp.datastore/V1ReadIT/testE2EV1ReadWithGQLQueryWithNoLimit/

Quoting:

java.lang.AssertionError: Combine.globally(Count)/Flatten.PCollections.out: 
Expected: <1000L>
     but: was <12000L>
 at org.apache.beam.sdk.testing.PAssert$PAssertionSite.capture(PAssert.java:165)
 at org.apache.beam.sdk.testing.PAssert.thatSingleton(PAssert.java:397)
 at org.apache.beam.sdk.testing.PAssert.thatSingleton(PAssert.java:387)
 at org.apache.beam.sdk.io.gcp.datastore.V1ReadIT.testE2EV1Read(V1ReadIT.java:95)

Issue Links

• links to: GitHub Pull Request #3962