[BEAM-7926] Show PCollection with Interactive Beam in a data-centric user flow

• Type: New Feature
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: runner-py-interactive
• Assignee: Ning
• Reporter: Ning
• Created: 08/Aug/19 00:35
• Updated: 16/May/20 14:04
• Resolved: 10/Mar/20 21:25

Description

Support auto plotting / charting of materialized data of a given PCollection with Interactive Beam.

Say an Interactive Beam pipeline defined as

 

p = beam.Pipeline(InteractiveRunner())
pcoll = p | 'Transform' >> transform()
pcoll2 = ...
pcoll3 = ...

The use can call a single function and get auto-magical charting of the data.

e.g.,

show(pcoll, pcoll2)

Throughout the process, a pipeline fragment is built to include only transforms necessary to produce the desired pcolls (pcoll and pcoll2) and execute that fragment.

This makes the Interactive Beam user flow data-centric.

 

Detailed design.

Issue Links

• blocks: BEAM-7923 Interactive Beam
• links to: GitHub Pull Request #9741
• links to: GitHub Pull Request #9771
• links to: GitHub Pull Request #10201
• links to: GitHub Pull Request #10276
• links to: GitHub Pull Request #10346
• links to: GitHub Pull Request #10731
• links to: GitHub Pull Request #11020