[HBASE-3411] manually compact memstores?

• Type: Brainstorming
• Status: Closed
• Priority: Major
• Resolution: Won't Fix
• Component/s: regionserver
• Assignee: Unassigned
• Reporter: Todd Lipcon
• Created: 04/Jan/11 19:43
• Updated: 12/Jun/22 00:42
• Resolved: 30/Oct/12 21:23

Description

I have a theory and some experiments that indicate our heap fragmentation issues has to do with the KV buffers from memstores ending up entirely interleaved in the old gen. I had a bit of wine and came up with a wacky idea to have a thread which continuously defragments memstore data buffers into contiguous segments, hopefully to keep old gen fragmentation down.

It didn't seem to work just yet, but wanted to show the patch to some people.