Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-8335

Add streaming support to Interactive Beam

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.20.0
    • runner-py-interactive
    • None

    Description

      This issue tracks the work items to introduce streaming support to the Interactive Beam experience. This will allow users to:

      • Write and run a streaming job in IPython
      • Automatically cache records from unbounded sources
      • Add a replay experience that replays all cached records to simulate the original pipeline execution
      • Add controls to play/pause/stop/step individual elements from the cached records
      • Add ability to inspect/visualize unbounded PCollections

      Attachments

        Activity

          People

            rohdesam Sam Rohde
            rohdesam Sam Rohde
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 116h 10m
                116h 10m