Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-14551 Unaligned checkpoints
  3. FLINK-16537

Implement ResultPartition state recovery for unaligned checkpoint

    XMLWordPrintableJSON

    Details

      Description

      During recovery process for unaligned checkpoint, the partition state should also be recovered besides with existing operator states.

      The ResultPartition would request buffer from local pool and then interact with ChannelStateReader to fill in the state data.  The filled buffer would be inserted into respective ResultSubpartition queue  in normal way.

      It should guarantee that op can not process any inputs before finishing all the output recovery to avoid mis-order issue.

      Refer to more details by https://docs.google.com/document/d/16_MOQymzxrKvUHXh6QFr2AAXIKt_2vPUf8vzKy4H_tU/edit

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                zjwang Zhijiang
                Reporter:
                zjwang Zhijiang
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 20m
                  20m