[PHOENIX-6181] IndexRepairRegionScanner to verify and repair every global index row

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 5.0.0, 4.14.3
• Fix Version/s: 5.1.0, 4.16.0
• Assignee: Kadir OZDEMIR
• Reporter: Kadir OZDEMIR
• Created: 07/Oct/20 17:07
• Updated: 27/Dec/20 09:28
• Resolved: 27/Oct/20 23:26

Description

IndexRebuildRegionScanner is the server side engine to rebuild and verify every index row pointed by the data table. IndexRebuildRegionScanner runs on data table regions and scans every data table rows locally, and then rebuilds and verifies index table rows referenced by the data table rows over server-to-server RPCs using the HBase client installed on region servers. However, IndexRebuildRegionScanner cannot clean up the index rows that are not referenced by the data table if there are such index rows. In order to do that we need another region scanner that scans index table regions and makes sure that every index row is valid. This region scanner will be called IndexRepairRegionScanner.

Issue Links

• causes: PHOENIX-6197 AggregateIT and StoreNullsIT hangs
• causes: PHOENIX-6283 MutableIndexExtendedIT#testCompactDisabledIndex consistently fails with HBase 2.3
• causes: PHOENIX-6195 Should not import com.google.guava directly
• is required by: PHOENIX-6182 IndexTool to verify and repair every index row
• links to: GitHub Pull Request #915