Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3522

Consider adding version information into rocksDB storage format

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.3.0
    • Component/s: streams
    • Labels:

      Description

      Kafka Streams does not introduce any modifications to the data format in the underlying Kafka protocol, but it does use RocksDB for persistent state storage, and currently its data format is fixed and hard-coded. We want to consider the evolution path in the future we we change the data format, and hence having some version info stored along with the storage file / directory would be useful.

      And this information could be even out of the storage file; for example, we can just use a small "version indicator" file in the rocksdb directory for this purposes. Thoughts? Eno Thereska Jay Kreps

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                mjsax Matthias J. Sax
                Reporter:
                guozhang Guozhang Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: