Details
-
Sub-task
-
Status: Closed
-
Blocker
-
Resolution: Implemented
-
None
Description
FLINK-14484 introduce a LRUCache to share among RocksDB instances, so that the memory usage by RocksDB could be controlled well. However, due to the implementation and some bugs in RocksDB (issue-6247), we cannot limit the memory strictly.
The way to walk around this issue is to consider the buffer which memtable would overuse (1/2 write buffer manager size). By introducing this, the actual cache size for user to share is not the same as the managed off-heap memory or user configured memory.
Attachments
Issue Links
- relates to
-
FLINK-15368 Add end-to-end test for controlling RocksDB memory usage
- Closed
-
FLINK-15532 Enable strict capacity limit for memory usage for RocksDB
- Open
- links to