Details
-
Bug
-
Status: Open
-
P2
-
Resolution: Unresolved
-
2.36.0
-
None
-
None
Description
Got the following exception with spark runner and GroupIntoBatches transform:
Caused by: java.lang.UnsupportedOperationException: Canceling a timer by ID is not yet supported.
at org.apache.beam.runners.core.InMemoryTimerInternals.deleteTimer(InMemoryTimerInternals.java:158)
at org.apache.beam.runners.core.SimpleDoFnRunner$TimerInternalsTimer.clear(SimpleDoFnRunner.java:1198)
at org.apache.beam.sdk.transforms.GroupIntoBatches$GroupIntoBatchesDoFn.processElement(GroupIntoBatches.java:474)
The InMemoryTimerInternals.deleteTimer with a timeDomain is not supported:
public void deleteTimer(
StateNamespace namespace, String timerId, String timerFamilyId, TimeDomain timeDomain)
However, this function is called by SimpleDoFnRunner$TimerInternalsTimer.clear:
public void clear()
{ this.timerInternals.deleteTimer(this.namespace, this.timerId, this.timerFamilyId, this.spec.getTimeDomain()); }Which is called by GroupIntoBatches$GroupIntoBatchesDoFn.processElement.