Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-1589

Add OnWindowExpiration method to Stateful DoFn

Details

    Description

      See BEAM-1517
      This allows the user to do some work before the state's garbage collection.
      It seems kind of annoying, but on the other hand forgetting to set a final timer to flush state is probably data loss most of the time.
      FlinkRunner does this work very simply, but other runners, such as DirectRunner, need to traverse all the states to do this, and maybe it's a little hard.

      Attachments

        Issue Links

          Activity

            People

              reuvenlax Reuven Lax
              lzljs3620320 Jingsong Lee
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 13h 40m
                  13h 40m