Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-3301 Go SplittableDoFn support
  3. BEAM-11019

Adjust Go SDF progress reporting to account for multi-window elements.

Details

    • Sub-task
    • Status: Resolved
    • P2
    • Resolution: Fixed
    • None
    • Not applicable
    • sdk-go
    • None

    Description

      SDF progress reporting should account for exploded windows. For example, if an element being processed is in three windows, and those windows get exploded, then it essentially is being processed 3 times. So after the first window's done, progress should be at 1/3, then at 2/3 after the second, and so on. Instead, at the moment progress is only reported for the current element which means it'll constantly loop from 0 -> 1.0 over and over as the element gets processed in each window.

      Attachments

        Issue Links

          Activity

            People

              danoliveira Daniel Oliveira
              danoliveira Daniel Oliveira
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m