[BEAM-8016] Render Beam Pipeline as DOT with Interactive Beam

• Type: Improvement
• Status: Triage Needed
• Priority: P2
• Resolution: Fixed
• Fix Version/s: 2.18.0
• Component/s: runner-py-interactive
• Assignee: Ning
• Reporter: Ning
• Created: 20/Aug/19 20:44
• Updated: 13/Apr/23 10:58
• Resolved: 02/Dec/19 22:26

Description

With work in https://issues.apache.org/jira/browse/BEAM-7760, Beam pipeline converted to DOT then rendered should mark user defined variables on edges.

With work in https://issues.apache.org/jira/browse/BEAM-7926, it might be redundant or confusing to render arbitrary random sample PCollection data on edges.

We'll also make sure edges in the graph corresponds to output -> input relationship in the user defined pipeline. Each edge is one output. If multiple down stream inputs take the same output, it should be rendered as one edge diverging into two instead of two edges.

For advanced interactivity highlight where each execution highlights the part of the pipeline really executed from the original pipeline, we'll also provide the support in beta.

Issue Links

• blocks: BEAM-7923 Interactive Beam
• links to: GitHub Pull Request #10132