[HBASE-3287] Add option to cache blocks on hfile write and evict blocks on hfile close

• Type: New Feature
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.90.0
• Fix Version/s: 0.92.0
• Component/s: io, regionserver
• Hadoop Flags: Reviewed

Release Note

Introduces two new configuration parameters: hbase.rs.cacheblocksonwrite (default: false) which will pre-cache all blocks of a file into the block cache as it is written, and hbase.rs.evictblocksonclose (default: true) which will evict all blocks of a file from the block cache when a file is closed on a RS.

• Assignee: Jonathan Gray
• Reporter: Jonathan Gray
• Created: 30/Nov/10 07:07
• Updated: 20/Nov/15 12:41
• Resolved: 30/Nov/10 20:42

Description

This issue is about adding configuration options to add/remove from the block cache when creating/closing files. For use cases with lots of flushing and compacting, this might be desirable to prevent cache misses and maximize the effective utilization of total block cache capacity.

The first option, hbase.rs.cacheblocksonwrite, will make it so we pre-cache blocks as we are writing out new files.

The second option, hbase.rs.evictblocksonclose, will make it so we evict blocks when files are closed.

Issue Links

• is related to: HBASE-3417 CacheOnWrite is using the temporary output path for block names, need to use a more consistent block naming scheme
• is related to: HBASE-3288 CacheOnWrite and EvictOnClose should be configurable on a per-family basis