Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-5997

EVENT_TIME timer throws exception when side input used

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: 2.7.0
    • Fix Version/s: None
    • Component/s: runner-direct
    • Labels:
      None

      Description

      Receive this exception when using a DoFn containing an EVENT_TIME timer and passing a side input. Pipeline processing aborts. It works as expected when the side input is absent.

      2018-11-06-12:03:32 ERROR o.a.b.r.direct.QuiescenceDriver - Internal Error while delivering timers
      java.lang.IllegalArgumentException: expected one element but was: <TestExpiry/TestingExpiry/ParMultiDo(TestExpiry)/To KeyedWorkItem/ParMultiDo(ToKeyedWorkItem).output [PCollection], TestExpiry/View.AsList/View.VoidKeyToMultimapMaterialization/ParDo(VoidKeyToMultimapMaterialization)/ParMultiDo(VoidKeyToMultimapMaterialization).output [PCollection]>
       at org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.collect.Iterators.getOnlyElement(Iterators.java:322)
       at org.apache.beam.repackaged.beam_runners_direct_java.com.google.common.collect.Iterables.getOnlyElement(Iterables.java:294)
       at org.apache.beam.runners.direct.QuiescenceDriver.fireTimers(QuiescenceDriver.java:167)
       at org.apache.beam.runners.direct.QuiescenceDriver.drive(QuiescenceDriver.java:110)
       at org.apache.beam.runners.direct.ExecutorServiceParallelExecutor$2.run(ExecutorServiceParallelExecutor.java:170)
       at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
       at java.util.concurrent.FutureTask.run(FutureTask.java:266)
       at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
       at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
       at java.lang.Thread.run(Thread.java:748)
      
      

        Attachments

        1. TestExpiry.java
          2 kB
          Laura Llewellyn

          Activity

            People

            • Assignee:
              danoliveira Daniel Oliveira
              Reporter:
              laurallew Laura Llewellyn
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: