[FLINK-13187] Expose batch slot request via new scheduling mode

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.9.0
• Fix Version/s: 1.9.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Till Rohrmann
• Reporter: Till Rohrmann
• Created: 10/Jul/19 06:57
• Updated: 10/Sep/19 15:07
• Resolved: 12/Jul/19 06:04

Description

In order to leverage the newly introduced batch slot request feature introduced with FLINK-13166, we should introduce a new ScheduleMode#LAZY_FROM_SOURCES_WITH_BATCH_SLOT_REQUESTS. Users who enable this, must make sure that the generated job does not contain any pipelined shuffles because this can lead to resource deadlocks (not timing out requests with too few slots to make a pipelined region run).

Issue Links

• causes: FLINK-14045 Rewrite DefaultExecutionSlotAllocator to use SlotProviderStrategy
• links to: GitHub Pull Request #9073