[BEAM-1724] ApexRunner should deduplicate when an UnboundedSource requires Deduping

• Type: Bug
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Fix Version/s: Missing
• Component/s: runner-apex
• Assignee: Unassigned
• Reporter: Thomas Groh
• Created: 15/Mar/17 00:52
• Updated: 13/Jan/22 21:51
• Resolved: 15/May/21 18:00

Description

The Apex implementation of UnboundedRead does not inspect the requiresDeduping property of an Unbounded Source. It should do so.

https://github.com/apache/beam/blob/master/runners/apex/src/main/java/org/apache/beam/runners/apex/translation/operators/ApexReadUnboundedInputOperator.java