[FLINK-3232] Add option to eagerly deploy channels

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 0.10.1
• Fix Version/s: 1.0.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Ufuk Celebi
• Reporter: Ufuk Celebi
• Created: 13/Jan/16 16:07
• Updated: 13/Jun/23 17:40
• Resolved: 15/Jan/16 10:55

Description

Intermediate partitions are consumed via input channels. These channels are instantiated lazily when the partition producer emits the first record. This can lead to higher latencies for the first records passing the pipeline.

In order to decrease this latency, we can deploy channels eagerly.

I would like to add this as a flag to the intermediate results of the execution graph. On deployment, the task can then deploy the input channels as soon as the intermediate stream has been registered at the partition manager.