Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-10354

Savepoints should be counted as retained checkpoints

    Details

    • Release Note:
      Hide
      Savepoints are now used while recovering. Previously when using exactly-once sink one could get into problems with duplicate output data when a failure occured after a savepoint was taken but before the next checkpoint occured.
      This results in the fact that savepoints are no longer exclusively under the control of the user. Savepoint should not be moved nor deleted if there was no newer checkpoint or savepoint taken.
      Show
      Savepoints are now used while recovering. Previously when using exactly-once sink one could get into problems with duplicate output data when a failure occured after a savepoint was taken but before the next checkpoint occured. This results in the fact that savepoints are no longer exclusively under the control of the user. Savepoint should not be moved nor deleted if there was no newer checkpoint or savepoint taken.

      Description

      This task is about reverting FLINK-6328.

      The problem is that you can get incorrect results with exactly-once sinks if there is a failure after taking a savepoint but before taking the next checkpoint because the savepoint will also have manifested side effects to the sink.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                dawidwys Dawid Wysakowicz
                Reporter:
                dawidwys Dawid Wysakowicz
              • Votes:
                0 Vote for this issue
                Watchers:
                5 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: