Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-7926

Show PCollection with Interactive Beam in a data-centric user flow

    XMLWordPrintableJSON

    Details

      Description

      Support auto plotting / charting of materialized data of a given PCollection with Interactive Beam.

      Say an Interactive Beam pipeline defined as

       

      p = beam.Pipeline(InteractiveRunner())
      pcoll = p | 'Transform' >> transform()
      pcoll2 = ...
      pcoll3 = ...

      The use can call a single function and get auto-magical charting of the data.

      e.g.,

      show(pcoll, pcoll2)
      

      Throughout the process, a pipeline fragment is built to include only transforms necessary to produce the desired pcolls (pcoll and pcoll2) and execute that fragment.

      This makes the Interactive Beam user flow data-centric.

       

      Detailed design.

        Attachments

          Activity

            People

            • Assignee:
              ningk Ning Kang
              Reporter:
              ningk Ning Kang
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 59h 50m
                59h 50m