[BEAM-1705] visualize the DAG of Pipeline

• Type: New Feature
• Status: Resolved
• Priority: P3
• Resolution: Won't Fix
• Fix Version/s: Not applicable
• Component/s: sdk-java-core
• Labels: Done
• Assignee: Mingmin Xu
• Reporter: Mingmin Xu
• Created: 13/Mar/17 20:26
• Updated: 06/Oct/20 21:59
• Resolved: 23/Oct/17 23:39

Description

After pipeline is compiled and run in different runners, such as Spark, Flink, it shows the data flow as a graph. There's limitation here:
1. the job must be run first;
2. The pipeline in a runner is not exact same as original designed, some steps are merged for example.

What to do:
a method or tool to show the DAG of pipeline in a graph, to display the native logic components, flows.