Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-10420

PerWindowInvoker to handle window observing SplittableDoFns

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: P2
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.24.0
    • Component/s: sdk-py-harness
    • Labels:

      Description

      Currently the FnApiDoFnRunner processes each element within it's own window. There is an easy optimization where we process the element once if and only if the function doesn't observe the window (either directly or indirectly via side inputs/state/...).

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                lcwik Luke Cwik
                Reporter:
                lcwik Luke Cwik
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 9h 40m
                  9h 40m