Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1929

Automatically adjust changelog topic level settings, when RocksDB TTL is set

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.0
    • kv-store
    • None

    Description

      When TTL is set on RocksDB, the default usage of log compacted topic for changelog isn't appropriate. Ideally, it should match the behavior with a TTL.

      So we would adjust changelog topic setting, when
      1) TTL is set for RocksDB and
      2) Changelog is enabled
      3) User has not set them

      And we would
      1) Disable log compaction on Kafka changelog topic
      2) Set topic TTL to be slightly larger than RocksDB TTL

      User should be able to override this behavior through TableDescriptor.withConfig()

       

      Attachments

        Issue Links

          Activity

            People

              weisong44 Wei Song
              weisong44 Wei Song
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: