Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-1589

Add OnWindowExpiration method to Stateful DoFn

    XMLWordPrintableJSON

    Details

      Description

      See BEAM-1517
      This allows the user to do some work before the state's garbage collection.
      It seems kind of annoying, but on the other hand forgetting to set a final timer to flush state is probably data loss most of the time.
      FlinkRunner does this work very simply, but other runners, such as DirectRunner, need to traverse all the states to do this, and maybe it's a little hard.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                reuvenlax Reuven Lax
                Reporter:
                lzljs3620320 Jingsong Lee
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 13h 40m
                  13h 40m