Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-647

A new KeyValueStore interface should support getAll(List<K>)

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.9.0
    • 0.10.0
    • kv

    Description

      For stores that support multiGet, like RocksDB, this can improve performance when batch querying; this could be simply implemented as a pass-through call to the underlying storage engine.
      For stores that don't support multiGet, we can simply return an iterator for the corresponding values by looping over keys and calling get() for each one.

      Attachments

        1. BatchingKeyValueStore.diff
          40 kB
          Mohamed Mahmoud (El-Geish)
        2. build.log
          10 kB
          Yi Pan
        3. build-1.err_pid49877.log
          41 kB
          Yi Pan
        4. getAllPerf.png
          66 kB
          Mohamed Mahmoud (El-Geish)

        Activity

          People

            elgeish Mohamed Mahmoud (El-Geish)
            elgeish Mohamed Mahmoud (El-Geish)
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: