Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-188

Merging WindowFn + GBK + Write => InvalidWindows throws UnsupportedOperationException

    XMLWordPrintableJSON

    Details

      Description

      The Write transform performs outputWithTimestamp(..., Instant.now()) in the finishBundle of one of the encapsulated ParDo transforms. This action causes the WindowFn to be invoked to assign a window to the output value. But a merging WindowFn such as Sessions will be replaced by InvalidWindows at the GBK where merging is performed, so this is destined to crash.

      It is almost certain that the window is not relevant, so we can quickly fix this by just windowing into the global window earlier and using vanilla output(...).

        Attachments

          Activity

            People

            • Assignee:
              dhalperi Dan Halperin
              Reporter:
              kenn Kenneth Knowles
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: