[BEAM-1102] Flink Batch Runner does not populate aggregator values

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Affects Version/s: 0.3.0-incubating
• Fix Version/s: 0.4.0
• Component/s: runner-flink
• Assignee: Aljoscha Krettek
• Reporter: Dan Halperin
• Created: 07/Dec/16 05:04
• Updated: 24/Jul/20 20:53
• Resolved: 07/Dec/16 07:31

Description

Running the quickstart gives 0 for emptyLines.

Running with --streaming=true gives the correct value (for my input file, the default examples archetype pom.xml, the true value is 27 at the time of writing).

Streaming output:

Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
INFO: Final aggregator values:
Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
INFO: DroppedDueToLateness : 0
Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
INFO: emptyLines : 27
Dec 07, 2016 1:00:53 PM org.apache.beam.runners.flink.FlinkRunner run
INFO: DroppedDueToClosedWindow : 0

Non-streaming output:

Dec 07, 2016 12:58:07 PM org.apache.beam.runners.flink.FlinkRunner run
INFO: Final aggregator values:
Dec 07, 2016 12:58:07 PM org.apache.beam.runners.flink.FlinkRunner run
INFO: emptyLines : 0

(Note also that the lateness etc. aggregators are missing entirely, may be expected).