[HBASE-28328] Add an option to count different types of Delete Markers in RowCounter

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.7.0, 3.0.0-beta-2, 2.5.11, 2.6.2
• Component/s: mapreduce
• Labels: pull-request-available
• Hadoop Flags: Reviewed

Release Note

The JIRA adds a feature in RowCounter tool to count the various types of delete markers (DELETE_COLUMN, DELETE_FAMILY, DELETE_FAMILY_VERSION) and the number of rows containing at least one delete marker. The feature can be enabled by passing the flag --countDeleteMarkers as a CLI option. When the feature is enabled, raw scan is performed without FirstKeyOnlyFilter.

• Assignee: Shubham Roy
• Reporter: Himanshu Gwalani
• Created: 25/Jan/24 05:59
• Updated: 03/Dec/24 22:28
• Resolved: 02/Dec/24 09:11

Description

Add an option (count-delete-markers) to the RowCounter tool to count the number of Delete Markers of all types, i.e. (DELETE, DELETE_COLUMN, DELETE_FAMILY,DELETE_FAMILY_VERSION)

We already have such a feature within our internal implementation of RowCounter and it's very useful.

Implementation Ideas:
1. If the option is passed, initialize the empty job counters for all 4 types of deletes.
2. Within mapper, increase the respective delete counts while processing each row.

Issue Links

• links to: GitHub Pull Request #6435
• links to: GitHub Pull Request #6496