Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-4507

Late elements windowed into expired fixed windows get dropped in Directrunner

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: P2
    • Resolution: Won't Fix
    • Affects Version/s: 2.4.0
    • Fix Version/s: 2.5.0
    • Component/s: runner-direct
    • Labels:
      None

      Description

      1- Create a elements that go into a combinar and then drops into a  Keyed Global Window, on entry setup a timer.
      Have the OnTime function:
      1- c.output the original element with a timestamp == to the original timestamp
      2- Create a new timestamp with element in the next window....
      2- LOG the output in a DoFn after the keyed state code, you should see all the values.
      3- Now apply a FixedWindow... and then try and log the output.. the original elements wont appear, but the new OnTime generated ones will.
       
      Tested in Dataflow runner and things work ok, the direct runner fails. 
       

        Attachments

          Activity

            People

            • Assignee:
              huygaa Batkhuyag Batsaikhan
              Reporter:
              rarokni@gmail.com Reza ardeshir rokni
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: