[HBASE-2453] Revisit compaction policies after HBASE-2248 commit

• Type: Improvement
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 0.90.0
• Hadoop Flags: Reviewed
• Assignee: Jonathan Gray
• Reporter: Jonathan Gray
• Created: 15/Apr/10 21:20
• Updated: 20/Nov/15 12:41
• Resolved: 16/Apr/10 01:12

Description

HBASE-2248 turned Gets into Scans server-side. It also removed the invariant that deletes in a file only apply to other files and not itself (no longer processes MemStore deletes when the delete happens). This has implications for our minor compaction policy.

We are currently processing deletes during minor compactions in a way that makes it so we do the actual deleting as we compact, but we retain the delete records themselves. This makes it so we retain the invariant of deletes only applying to other files.

Since this is now gone post HBASE-2248, we should revisit our compaction policies.

Issue Links

• is related to: HBASE-2462 Review compaction heuristic and move compaction code out so standalone and independently testable