[HBASE-11351] Experiments with OffHeap memstores

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Abandoned
• Assignee: Unassigned
• Reporter: Lars Hofhansl
• Created: 13/Jun/14 22:28
• Updated: 17/Jun/22 05:58
• Resolved: 11/Jun/22 18:45

Description

I have been experimenting with offheap memstores using an offheap BTree implementation of ConcurrentMap provided by MapDB (www.mapdb.org)

So far I hooked this up in an experimental way with inefficient serialization (in the sense that due to our special usage of the set api we need to back the set by a map, which in the off heap case means we need to serialize and store the value twice. It is used as key and value). But it works.

It's quite a bit slower and due to need to deserialize upon scan it produces more short term garbage.

Let's use this issue to discuss.

Issue Links

• is related to: HBASE-10191 Move large arena storage off heap