[HBASE-10885] Support visibility expressions on Deletes

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 0.98.1
• Fix Version/s: 0.99.0, 0.98.4
• Hadoop Flags: Reviewed

Release Note

Deletes can be specified with Cell Visibility as done for puts.
Cells covered by the delete is found by doing pattern matching.
A deleteFamily issued for row1, f1 with Cell Visibility (A & B) would delete only those cells of row1 under family f1 which has cell visibility A&B or B&A. A delete without any cell visibility would only delete those cells that does not have any cell visibility.
In case of delete specific column with latest version only the latest cell with the specified cell visibility will be covered by the delete marker. In case there is no such cell with the specified cell visibility then no cell gets deleted.

• Assignee: ramkrishna.s.vasudevan
• Reporter: Andrew Kyle Purtell
• Created: 01/Apr/14 07:59
• Updated: 06/Apr/18 17:51
• Resolved: 04/Jul/14 18:32

Description

Accumulo can specify visibility expressions for delete markers. During compaction the cells covered by the tombstone are determined in part by matching the visibility expression. This is useful for the use case of data set coalescing, where entries from multiple data sets carrying different labels are combined into one common large table. Later, a subset of entries can be conveniently removed using visibility expressions.

Currently doing the same in HBase would only be possible with a custom coprocessor. Otherwise, a Delete will affect all cells covered by the tombstone regardless of any visibility expression scoping. This is correct behavior in that no data spill is possible, but certainly could be surprising, and is only meant to be transitional. We decided not to support visibility expressions on Deletes to control the complexity of the initial implementation.

Issue Links

• is depended upon by: HBASE-11222 Add integration test for visibility deletes
• is depended upon by: HBASE-11256 [Visibility Controller] Enhance IntegrationTestWithCellVisibilityLoadAndVerify to verify delete behaviour

Sub-Tasks

• Change DeleteTracker APIs to work with Cell: Closed
• Create new hook in StoreScanner to help user creating his own delete tracker: Closed
• Support Visibility Expression Deletes in Shell: Closed
• [Visibility Controller]Check for users covering authorizations for every mutation: Closed
• [Visibility Controller]Check covering permission of the user issuing Delete for deletes without Cell Visibility: Closed