Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
None
-
None
-
None
Description
Limit operator currently invokes kill() when it reaches the desired limit of records. Current semantic of kill() does not stop upstream operators if they are across exchanges. So its the responsibility of the operator to drain out all the record batches and clear the memory, otherwise we will hit memory leaks.