[BEAM-1130] SparkRunner ResumeFromCheckpointStreamingTest Failing

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 0.4.0
• Component/s: runner-spark
• Assignee: Amit Sela
• Reporter: Jason Kuster
• Created: 12/Dec/16 01:51
• Updated: 16/May/20 13:46
• Resolved: 13/Dec/16 07:56

Description

Failing in (at least) suites:
https://builds.apache.org/job/beam_PostCommit_Java_RunnableOnService_Spark/
381 - 385
https://builds.apache.org/job/beam_PostCommit_Java_MavenInstall/
2063 - 2066

Culprit change seems to be:
https://github.com/apache/incubator-beam/commit/aba40e2de9ba058f33086eb6a913fa583a82b058

Error:

Success aggregator should be greater than zero.
Expected: not <0>
     but: was <0>

Sample output:
https://builds.apache.org/job/beam_PostCommit_Java_RunnableOnService_Spark/lastCompletedBuild/org.apache.beam$beam-runners-spark/testReport/org.apache.beam.runners.spark.translation.streaming/ResumeFromCheckpointStreamingTest/testRun/

Issue Links

• is related to: BEAM-1133 Add maxNumRecords per micro-batch for Spark runner options.
• links to: GitHub Pull Request #1579