Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-3301 Go SplittableDoFn support
  3. BEAM-11019

Adjust Go SDF progress reporting to account for multi-window elements.

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: P2
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: Not applicable
    • Component/s: sdk-go
    • Labels:
      None

      Description

      SDF progress reporting should account for exploded windows. For example, if an element being processed is in three windows, and those windows get exploded, then it essentially is being processed 3 times. So after the first window's done, progress should be at 1/3, then at 2/3 after the second, and so on. Instead, at the moment progress is only reported for the current element which means it'll constantly loop from 0 -> 1.0 over and over as the element gets processed in each window.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                danoliveira Daniel Oliveira
                Reporter:
                danoliveira Daniel Oliveira
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 20m
                  1h 20m