Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-10420

PerWindowInvoker to handle window observing SplittableDoFns

Details

    • Improvement
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • 2.24.0
    • sdk-py-harness

    Description

      Currently the FnApiDoFnRunner processes each element within it's own window. There is an easy optimization where we process the element once if and only if the function doesn't observe the window (either directly or indirectly via side inputs/state/...).

      Attachments

        Issue Links

          Activity

            People

              lcwik Luke Cwik
              lcwik Luke Cwik
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 9h 40m
                  9h 40m