[FLINK-11875] Enhance stream operator API to support selective reading and EndOfInput event

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.9.0
• Component/s: Runtime / Task
• Assignee: Haibo Sun
• Reporter: Haibo Sun
• Created: 12/Mar/19 02:29
• Updated: 30/Sep/19 12:31
• Resolved: 30/Sep/19 12:30

Description

Towards the goal that unify Streaming and Batch, this jira proposes enhanced stream operator api to support selective reading and EndOfInput event for currently Batch’s requirements.

Design Doc

Discussion Mail

Sub-Tasks

• Introduce the new interfaces InputSelectable, BoundedOneInput and BoundedMultiInput: Closed
• Implement the runtime handling of the InputSelectable interface: Closed
• Implement the runtime handling of BoundedOneInput and BoundedMultiInput: Closed
• Add JobGraph validators for the uses of InputSelectable, BoundedOneInput and BoundedMultiInput: Closed
• Replace listeners with CompletableFuture in InputGates: Closed
• Introduce NetworkInput class: Closed
• Make CheckpointBarrierHandler non-blocking: Closed
• Support CheckpointBarrierHandler in StreamTwoInputSelectableProcessor: Closed
• Change the input selection switching in StreamTwoInputSelectableProcessor#checkFinished to invoking the nextSelection method of the stream operator: Closed
• Drop the non-selectable two-input StreamTask and Processor: Closed
• Add JobGraph validators for the uses of TwoInputSelectable, BoundedOneInput and BoundedTwoInput: Closed
• Add micro benchmarks for two-input processors: Closed
• Change the endinput call of the downstream operator to after the upstream operator closes: Closed