[HBASE-3160] Compactions: Use more intelligent priorities for PriorityCompactionQueue

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.89.20100924, 0.90.0
• Fix Version/s: 0.90.0
• Hadoop Flags: Reviewed
• Assignee: Nicolas Spiegelberg
• Reporter: Nicolas Spiegelberg
• Created: 27/Oct/10 18:45
• Updated: 12/Oct/12 06:17
• Resolved: 29/Oct/10 06:10

Description

One of the problems with the current compaction queue is that we have a very low granularity on the importance of the various compactions in the queue. If a StoreFile count exceeds 15 files, only then do we bump via enum change. We should instead look into more intelligent, granular priority metrics for choosing the next compaction.

Issue Links

• incorporates: HBASE-2770 Major compactions from shell may not major compact all families
• is part of: HBASE-2462 Review compaction heuristic and move compaction code out so standalone and independently testable
• is related to: HBASE-2646 Compaction requests should be prioritized to prevent blocking