Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
Description
Reference: https://github.com/apache/incubator-nemo/pull/135/files#r229178956
GroupByKeyAndWindowTransform calls DoFnRunner.processElement() every watermark, to reduce the overhead of calling processElement(). But, this approach can delay the event processing in streaming, if the watermark is not triggered for a long time.
It would be good to create another GroupByKeyAndWindowTransform for streaming operations.
Attachments
Issue Links
- is caused by
-
NEMO-230 Emit collected data when receiving watermark in GroupByKeyAndWindowTransform
- Resolved