[KAFKA-3777] Extract the existing LRU cache out of RocksDBStore

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.10.1.0
• Fix Version/s: 0.10.1.0
• Component/s: streams
• Assignee: Damian Guy
• Reporter: Eno Thereska
• Reviewer: Eno Thereska
• Created: 02/Jun/16 10:41
• Updated: 16/Sep/16 20:43
• Resolved: 16/Sep/16 20:43

Description

The LRU cache that is currently inside the RocksDbStore class. As part of KAFKA-3776 it needs to come outside of RocksDbStore and be a separate component used in:

1. KGroupedStream.aggregate() / reduce(),
2. KStream.aggregateByKey() / reduceByKey(),
3. KTable.to() (this will be done in KAFKA-3779).

As all of the above operators can have a cache on top to deduplicate the materialized state store in RocksDB.

The scope of this JIRA is to extract out the cache of RocksDBStore, and keep them as item 1) and 2) above; and it should be done together / after KAFKA-3780.

Note it is NOT in the scope of this JIRA to re-write the cache, so this will basically stay the same record-based cache we currently have.