Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Won't Fix
-
0.20.0, 0.90.0
-
None
-
None
-
None
Description
There are some additional optimizations in the specialized StoreScanner and also in HFile for minor compactions. For example, there is some KV disassembling and sanity checking in HFile even though in a minor compaction these checks have already been run during the flush.
Another area to discuss is whether we should actually process deletes during minor compactions. It's not especially expensive (ScanDeleteTracker is quite simple) but it requires looking at both the row and the qualifier value of every single KV. Removing this would drop our axiom that "Deletes only apply to later storefiles", which is used during Get processing to have more efficient delete handling.