Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-17411

StateStore managed changelog offsets

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • streams

    Description

      Kafka Streams currently tracks the changelog offsets that correspond to local state in per-Task .checkpoint files, that are maintained by the internal Streams engine, independently of the StateStore implementation being used. Allowing StateStores to instead manage their changelog offsets themselves enables them to optimise the storage and management of both the changelog offsets and the corresponding data.

      For more detail, see KIP-1035

      Attachments

        Issue Links

          Activity

            People

              nicktelford Nicholas Telford
              nicktelford Nicholas Telford
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated: