Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-10362

When resuming Streams active task with EOS, the checkpoint file should be deleted

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.6.0
    • Fix Version/s: 2.7.0, 2.6.2
    • Component/s: streams
    • Labels:

      Description

      Today when we suspend a task we commit and along with the commit we always write checkpoint file even if we are eosEnabled (since the state is already SUSPENDED). But the suspended task may later be resumed and in that case the checkpoint file should be deleted since it should only be written when it is cleanly closed.

      With our latest rebalance protocol in KIP-429, resume would not be called since all suspended tasks would be closed, but with the old eager protocol it may still be called — I think that may be the reason we did not get it often.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                DOJI Sharath Bhat
                Reporter:
                guozhang Guozhang Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: