Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-4815 Idempotent/transactional Producer (KIP-98)
  3. KAFKA-5435

Produce state lost if no snapshot retained

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Blocker
    • Resolution: Fixed
    • None
    • 0.11.0.0
    • clients, core, producer
    • None

    Description

      We have an optimization in Log to avoid the need to scan the log to build producer state during the upgrade path. Basically, if no producer snapshot exists, then we assume that it's an upgrade and take a new snapshot from the end of the log. Unfortunately, it can happen that snapshot files are never created or are deleted through truncation. Upon reinitialization, this can cause the optimization above to kick in and we lose the current state of all producers.

      Attachments

        Issue Links

          is duplicated by

          Sub-task - The sub-task of the issue KAFKA-5436 NullPointerException when loading producer snapshot

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved
          links to

          Web Link GitHub Pull Request #3306

          Web Link GitHub Pull Request #3361

          Activity

            People

              hachikuji Jason Gustafson
              hachikuji Jason Gustafson
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: