[IOTDB-854] [Distributed] Limit the memory foorprint of the committed log cache

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: Core/Cluster
• Labels: distributed log-management pull-request-available
• Assignee: Tan xinyu
• Reporter: Tian Jiang
• Created: 28/Aug/20 01:43
• Updated: 25/Mar/21 01:18

Description

Different from other K-V systems using the raft algorithm, Distributed IoTDB store significantly larger amounts of data in a raft log (as data ingestion of IoTDB is usually suggested in a batched manner). As a result, normal log management which concerns the number of log entries may not work very well, and risks in OOM.

So, it is important that we calculate the memory occupation of committed logs and put a limit on them.

Issue Links

• is a child of: IOTDB-68 IoTDB supports distributed version
• links to: GitHub Pull Request #2879