Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-236

Switch samza-kv to use RocksDB

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.8.0
    • 0.8.0
    • kv
    • None

    Description

      The samza-kv implementation is currently using LevelDB. RocksDB seems to have a number of interesting options that would be useful to Samza:

      1. Ability to swap out skip list for a faster implementation when restoring data from a changelog stream.
      2. Ability to disable compaction during changelog stream restoration.
      3. Ability to have a single level (or single SST) rather than multiple levels in order to reduce read amplification.
      4. A merge operation for doing lazy read-modify-write during compaction.

      And a lot more.

      Attachments

        1. SAMZA-236.diff
          20 kB
          Naveen Somasundaram
        2. SAMZA-236-1.patch
          10 kB
          Chris Riccomini

        Issue Links

          Activity

            People

              naveenatceg Naveen Somasundaram
              criccomini Chris Riccomini
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: