[HBASE-3797] StoreFile Level Compaction Locking

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 0.92.0
• Assignee: Nicolas Spiegelberg
• Reporter: Nicolas Spiegelberg
• Created: 18/Apr/11 20:59
• Updated: 20/Nov/15 12:42
• Resolved: 10/May/11 23:36

Description

Multithreaded compactions (HBASE-1476) will solve the problem of major compactions clogging high-priority minor compactions. However, there is still a problem here. Since compactions are store-level, the store undergoing major compaction will have it's storefile count increase during the major. We really need a way to allow multiple outstanding compactions per store. compactSelection() should lock/reserve the files being used for compaction. This will also allow us to know what we're going to compact when inserting into the CompactSplitThread and make more informed priority queueing decisions.

Issue Links

• is depended upon by: HBASE-1476 scaling compaction with multiple threads
• is required by: HBASE-3842 Refactor Coprocessor Compaction API
• requires: HBASE-3796 Per-Store Entries in Compaction Queue