[HBASE-5891] Change Compression Based on Type of Compaction

• Type: New Feature
• Status: Closed
• Priority: Minor
• Resolution: Not A Problem
• Assignee: Unassigned
• Reporter: Nicolas Spiegelberg
• Created: 27/Apr/12 20:37
• Updated: 13/Jun/22 16:16
• Resolved: 11/Apr/15 01:30

Description

We currently use LZO on our production systems because the on-demand decompression speed of GZ is too slow. That said, many of our major-compacted StoreFiles are infrequently read because of lazy seek optimizations, but they occupy the majority of our disk space. One idea is to change the type of compression depending upon compaction characteristics (input size or major compaction flag). This would allow us to have our largest and least-read files be GZ compressed and save space.