[FLINK-14877] Enable FRocksDB to optimize performance via options when bounding total memory

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 1.10.0
• Assignee: Yun Tang
• Reporter: Yun Tang
• Created: 20/Nov/19 13:53
• Updated: 23/Nov/19 07:02
• Resolved: 23/Nov/19 07:02

Description

Currently, as we plan to keep base on RocksDB-5.17.2 and cherry-pick write-buffer manager related rocksJava commits to FRocksDB. Options below are recommend when bounding the total memory.

tableConfig.setCacheIndexAndFilterBlocksWithHighPriority(true);
tableConfig.setPinTopLevelIndexAndFilter(true);

However, RocksDB-5.17.2 does not include these java API. But luckily, these features are already implemented on RocksDB's native code. Cherry pick https://github.com/facebook/rocksdb/pull/4589 with only updates on java side should be enough.

Issue Links

• links to: frocksdb-pr-6