[BEAM-5707] Add a portable Flink streaming synthetic source for testing

• Type: Improvement
• Status: Resolved
• Priority: P3
• Resolution: Fixed
• Fix Version/s: 2.9.0
• Component/s: runner-flink
• Assignee: Micah Wylde
• Reporter: Micah Wylde
• Created: 10/Oct/18 20:02
• Updated: 16/May/20 13:26
• Resolved: 17/Oct/18 15:39

Description

Currently there are no built-in streaming sources for portable pipelines. This makes it hard to test streaming functionality in the Python SDK.

It would be very useful to add a periodic impulse source that (with some configurable frequency) outputs an empty byte array, which can then be transformed as desired inside the python pipeline. More context in this mailing list discussion.

Issue Links

• links to: GitHub Pull Request #6637
• links to: GitHub Pull Request #6737
• links to: GitHub Pull Request #6774
• links to: GitHub Pull Request #9728