Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-2504

Processing time timers with timestamp past GC time are interpreted as GC timers

Details

    • Bug
    • Status: Resolved
    • P0
    • Resolution: Fixed
    • None
    • 2.1.0
    • runner-core
    • None

    Description

      The affects accumulating mode most acutely: when a processing time trigger fires and processing is ahead of the watermark (which it usually will be) there will be a final pane from the premature GC. Then, if no more data comes in, the GC timer fires and outputs another pane marked "final" but this time with an empty (aka zero) accumulator. This is a likely scenario since the processing time timer is probably just a smidge ahead of the watermark. So any sink writing the accumulated value will fill with zeros mostly, some correct values, and other values that are just the data from the last moments before GC.

      This would also have a severe affect on merging windows, since merging terminates upon GC.

      Attachments

        Activity

          People

            kenn Kenneth Knowles
            kenn Kenneth Knowles
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: