Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8016

Render Beam Pipeline as DOT with Interactive Beam

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.18.0
    • Component/s: runner-py-interactive
    • Labels:
      None

      Description

      With work in https://issues.apache.org/jira/browse/BEAM-7760, Beam pipeline converted to DOT then rendered should mark user defined variables on edges.

      With work in https://issues.apache.org/jira/browse/BEAM-7926, it might be redundant or confusing to render arbitrary random sample PCollection data on edges.

      We'll also make sure edges in the graph corresponds to output -> input relationship in the user defined pipeline. Each edge is one output. If multiple down stream inputs take the same output, it should be rendered as one edge diverging into two instead of two edges.

      For advanced interactivity highlight where each execution highlights the part of the pipeline really executed from the original pipeline, we'll also provide the support in beta.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                ningk Ning Kang
                Reporter:
                ningk Ning Kang
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 7h 10m
                  7h 10m