[HBASE-21874] Bucket cache on Persistent memory

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha-1
• Fix Version/s: 3.0.0-alpha-1, 2.3.0
• Component/s: BucketCache
• Hadoop Flags: Reviewed

Release Note

Added a new IOEngine type for Bucket cache ie Persistent memory. In order to use BC over pmem configure IOEngine as
<property>
    <name>hbase.bucketcache.ioengine</name>
    <value> pmem:///path in persistent memory </value>
  </property>

• Assignee: ramkrishna.s.vasudevan
• Reporter: ramkrishna.s.vasudevan
• Created: 12/Feb/19 06:37
• Updated: 08/Dec/20 07:26
• Resolved: 17/Sep/19 14:14

Description

Non volatile persistent memory devices are byte addressable like DRAM (for eg. Intel DCPMM). Bucket cache implementation can take advantage of this new memory type and can make use of the existing offheap data structures to serve data directly from this memory area without having to bring the data to onheap.

The patch is a new IOEngine implementation that works with the persistent memory.

Note : Here we don't make use of the persistence nature of the device and just make use of the big memory it provides.

Performance numbers to follow.