[FLINK-20721] Remove unknown input channels and process to update partitions

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Won't Do
• Affects Version/s: 1.13.0
• Fix Version/s: 1.13.0
• Component/s: Runtime / Coordination, Runtime / Network
• Labels: pull-request-available
• Assignee: Zhu Zhu
• Reporter: Zhu Zhu
• Created: 22/Dec/20 12:27
• Updated: 23/Dec/20 10:57
• Resolved: 23/Dec/20 10:56

Description

With the latest pipelined region scheduling, Flink no longer launch a task before knowing the locations of all the partitions it consumes. `scheduleOrUpdateConsumers` is no longer needed and is removed in FLINK-20439.

Unknown input channels and the process to update it is also no longer needed. I'd propose to remove them and the benefits are:
1. simplifying the code of both scheduler and shuffle components
2. simplifying interfaces of ShuffleEnvironment and ShuffleDescriptor
3. ensure the assumptions in InputGate#resumeConsumption() implementations
4. allow to remove ScheduleMode#allowLazyDeployment() and later completely remove ScheduleMode

Issue Links

• links to: GitHub Pull Request #14463