[FLINK-19485] Decouple runtime operator implementation from DataStream operations

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Affects Version/s: 1.12.0
• Component/s: API / DataStream
• Labels: pull-request-available
• Assignee: Kostas Kloudas
• Reporter: Kostas Kloudas
• Created: 01/Oct/20 07:30
• Updated: 12/Oct/20 18:01
• Resolved: 12/Oct/20 13:53

Description

Although DataStream is going to be the unified API for Batch and Streaming applications, some operations, e.g. Sinks, may need to have different runtime implementations depending on if they are intended to run on bounded or unbounded data. This is not necessarily only for optimisations but also for the exposed semantics, i.e. correctness.

So far, DataStream had a 1-to-1 mapping between an API call and an operator. In a sense, the DataStream API was an "explicit" API. With this addition, we will decouple the API calls from the actual runtime implementations and thus allow different operations to have more than one runtime implementations, depending (for now) on the execution.runtime-mode.

Issue Links

• links to: GitHub Pull Request #13556
• links to: GitHub Pull Request #13556