Uploaded image for project: 'Kafka'
  1. Kafka
  2. KAFKA-3776 Unify store and downstream caching in streams
  3. KAFKA-3778

Avoiding using range queries of RocksDBWindowStore on KStream windowed aggregations

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.1.0
    • Fix Version/s: 0.10.1.0
    • Component/s: streams
    • Labels:
      None

      Description

      RocksDbWindowStore currently does not use caches, but its window segments implemented as RocksDbStore does. However, its range query fetch(key, fromTime, toTime) will cause all its touched segments' cache to be flushed.

      After KAFKA-3777, we should change its implementation for KStreamWindowAggregation / KStreamWindowReduce to not use fetch, but just as multiple get calls on the underlying segments, one for each affected window range.

        Attachments

          Activity

            People

            • Assignee:
              enothereska Eno Thereska
              Reporter:
              enothereska Eno Thereska
              Reviewer:
              Eno Thereska
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: