[BEAM-10400] DirectRunner: race condition in watermark update

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Affects Version/s: 2.23.0
• Fix Version/s: 2.24.0
• Component/s: runner-direct
• Assignee: Jan Lukavský
• Reporter: Jan Lukavský
• Created: 01/Jul/20 19:36
• Updated: 15/May/21 17:59
• Resolved: 15/May/21 17:59

Description

When watermark is updated in upstream PTransform, it is instantly propagated as input watermark to all directly connected downstream PTransforms. We must ensure that all output bundles that were emitted before the watermark update are processed before we allow updating input watermark of downstream PTransform.

Issue Links

• links to: GitHub Pull Request #12155