[FLINK-14312] Support building logical pipelined regions from JobGraph

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Done
• Affects Version/s: 1.10.0
• Fix Version/s: 1.10.0
• Component/s: Runtime / Coordination
• Labels: pull-request-available
• Assignee: Zhu Zhu
• Reporter: Zhu Zhu
• Created: 02/Oct/19 08:50
• Updated: 01/Nov/19 14:45
• Resolved: 01/Nov/19 14:45

Description

Logical pipelined region partitioning is needed by FLINK-14060 to determine JobVertex slot sharing group.
We can leverage PipelinedRegionComputeUtil#computePipelinedRegions to do this by adapting JobGraph to a base Topology.

With changes from FLINK-14453, we can build LogicalPipelinedRegions from JobGraph by:
1. Introduce LogicalTopology which extends Topology
2. Implement DefaultLogicalTopology as an adapter of JobGraph to LogicalTopology
3. Add DefaultLogicalTopology#getLogicalPipelinedRegions to return the logical pipelined regions of a JobGraph

Issue Links

• blocks: FLINK-14060 Set slot sharing groups according to pipelined regions
• is blocked by: FLINK-14453 Support building pipelined regions from base topology
• links to: GitHub Pull Request #10006