[HBASE-2462] Review compaction heuristic and move compaction code out so standalone and independently testable

• Type: Improvement
• Status: Closed
• Priority: Critical
• Resolution: Won't Fix
• Component/s: Performance
• Labels: moved_from_0_20_5
• Assignee: Unassigned
• Reporter: Michael Stack
• Created: 17/Apr/10 03:20
• Updated: 11/Jun/22 23:32
• Resolved: 23/Mar/12 22:28

Description

Anything that improves our i/o profile makes hbase run smoother. Over in HBASE-2457, good work has been done already describing the tension between minimizing compactions versus minimizing count of store files. This issue is about following on from what has been done in 2457 but also, breaking the hard-to-read compaction code out of Store.java out to a standalone class that can be the easier tested (and easily analyzed for its performance characteristics).

If possible, in the refactor, we'd allow specification of alternate merge sort implementations.

Issue Links

• incorporates: HBASE-3160 Compactions: Use more intelligent priorities for PriorityCompactionQueue
• is related to: HBASE-3209 New Compaction Heuristic
• relates to: HBASE-2453 Revisit compaction policies after HBASE-2248 commit