[HBASE-5311] Allow inmemory Memstore compactions

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Assignee: Unassigned
• Reporter: Lars Hofhansl
• Created: 01/Feb/12 04:45
• Updated: 12/Jun/22 20:16
• Resolved: 07/Apr/17 00:05

Description

Just like we periodically compact the StoreFiles we should also periodically compact the MemStore.
During these compactions we eliminate deleted cells, expired cells, cells to removed because of version count, etc, before we even do a memstore flush.

Besides the optimization that we could get from this, it should also allow us to remove the special handling of ICV, Increment, and Append (all of which use upsert logic to avoid accumulating excessive cells in the Memstore).

Not targeting this.

Issue Links

• is related to: HBASE-13408 HBase In-Memory Memstore Compaction
• relates to: HBASE-10191 Move large arena storage off heap