[KUDU-2174] More efficient storage for ConsensusMetadata

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Fix Version/s: NA
• Component/s: consensus
• Labels: roadmap-candidate scalability
• Assignee: Unassigned
• Reporter: Mike Percy
• Created: 06/Oct/17 01:16
• Updated: 02/Jun/20 20:54
• Resolved: 02/Jun/20 20:54

Description

Consider using LMDB or RocksDB to more efficiently store ConsensusMetadata (cmeta) on disk. This would be more efficient than our current use of a single file per cmeta because it these systems batch writes therefore reducing fsyncs and improving write throughput.

Issue Links

• duplicates: KUDU-2204 Revamp storage of tablet server metadata