[BEAM-14261] Create a Watch transform in Python

• Type: New Feature
• Status: Open
• Priority: P2
• Resolution: Unresolved
• Component/s: io-py-common
• Assignee: Unassigned
• Reporter: John Casey
• Created: 05/Apr/22 19:44
• Updated: 05/Jun/22 00:13

Description

Currently we have a Watch transform in the Java SDK that is very useful when periodically polling for new input to a pipeline. We would like a parallel transform in Python.

https://github.com/apache/beam/blob/master/sdks/java/core/src/main/java/org/apache/beam/sdk/transforms/Watch.java