[BEAM-9312] Make MonotonicWatermarkEstimator configurable for whether to ignore late timestamp.

• Type: Improvement
• Status: Open
• Priority: P3
• Resolution: Unresolved
• Component/s: sdk-py-core, sdk-py-harness
• Assignee: Unassigned
• Reporter: Boyuan Zhang
• Created: 14/Feb/20 00:01
• Updated: 04/Jun/22 14:47

Description

Current implementation of MonotonicWatermarkEstimator throws error and stop the pipeline when there is a late timestamp. But there are more potential options like:
(1) Suppress the error and emit the item as possibly late data.
(2) Move the timestamp forward to respect the watermark.
We should consider making MonotonicWatermarkEstimator configurable with these options, or providing different types of MonotonicWatermarkEstimator to handle different options.