Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
Description
During recovery process for unaligned checkpoint, the partition state should also be recovered besides with existing operator states.
The ResultPartition would request buffer from local pool and then interact with ChannelStateReader to fill in the state data. The filled buffer would be inserted into respective ResultSubpartition queue in normal way.
It should guarantee that op can not process any inputs before finishing all the output recovery to avoid mis-order issue.
Refer to more details by https://docs.google.com/document/d/16_MOQymzxrKvUHXh6QFr2AAXIKt_2vPUf8vzKy4H_tU/edit
Attachments
Issue Links
- causes
-
FLINK-17440 Potential Buffer leak in output unspilling for unaligned checkpoints
- Closed
- links to