Details
-
Sub-task
-
Status: Resolved
-
Major
-
Resolution: Done
-
1.10.0
Description
When working on FLINK-14312 to partition JobGraph into logical pipelined regions, I found that we can hardly reuse the existing util PipelinedRegionComputeUtil#computePipelinedRegions(..) to do it since it's based on the FailoverTopology.
To avoid code duplication, we need a unified topology base for FailoverTopology and JobGraph/LogicalTopology.
Besides that, the inconsistency of FailoverTopology and SchedulingTopology is also causing troubles for development and performance.
That's why I'd propose to unify the interfaces all these topologies. More details can be found in this design doc.
Attachments
Issue Links
- relates to
-
FLINK-14450 Refactor SchedulingTopology to extend base topology
- Resolved
-
FLINK-14451 Refactor FailoverTopology to extend base topology
- Resolved
-
FLINK-14452 Keep only one execution topology in scheduler
- Resolved
-
FLINK-14453 Support building pipelined regions from base topology
- Resolved
- links to