Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3776 Unify store and downstream caching in streams
  3. KAFKA-3778

Avoiding using range queries of RocksDBWindowStore on KStream windowed aggregations

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.10.1.0
    • 0.10.1.0
    • streams
    • None

    Description

      RocksDbWindowStore currently does not use caches, but its window segments implemented as RocksDbStore does. However, its range query fetch(key, fromTime, toTime) will cause all its touched segments' cache to be flushed.

      After KAFKA-3777, we should change its implementation for KStreamWindowAggregation / KStreamWindowReduce to not use fetch, but just as multiple get calls on the underlying segments, one for each affected window range.

      Attachments

        Activity

          People

            enothereska Eno Thereska
            enothereska Eno Thereska
            Eno Thereska Eno Thereska
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: