Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-2491

Checkpointing only works if all operators/tasks are still running

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: In Progress
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: 0.10.0
    • Fix Version/s: None
    • Labels:
      None

      Description

      While implementing a test case for the Kafka Consumer, I came across the following bug:

      Consider the following topology, with the operator parallelism in parentheses:

      Source (2) --> Sink (1).

      In this setup, the snapshotState() method is called on the source, but not on the Sink.
      The sink receives the generated data.
      only one of the two sources is generating data.

      I've implemented a test case for this, you can find it here: https://github.com/rmetzger/flink/blob/para_checkpoint_bug/flink-tests/src/test/java/org/apache/flink/test/checkpointing/ParallelismChangeCheckpoinedITCase.java

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                rmetzger Robert Metzger
              • Votes:
                13 Vote for this issue
                Watchers:
                52 Start watching this issue

                Dates

                • Created:
                  Updated: