[PHOENIX-5503] IndexTool does not rebuild all the rows

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 5.0.0, 4.15.0, 4.14.3
• Fix Version/s: 5.1.0
• Assignee: Kadir OZDEMIR
• Reporter: Kadir Ozdemir
• Created: 01/Oct/19 00:04
• Updated: 10/Feb/21 10:00
• Resolved: 01/Oct/19 21:39

Description

IndexTool builds a subset of the rows of an index table. The rows that are created after the time specified by the timestamp of the PTable (i.e., table metadata structure maintained in memory) for the index table are not rebuilt. This timestamp is updated by the PTable builder, that is,  at the time of creating the PTable structure int memory. Based on the comment on the code (see IndexTool.getJob()), this is done to "ensure index tables remains consistent post population".  Such consistency issue may exist for client side index build but PHOENIX-5018 (server side index build) does not have such an issue. However, PHOENIX-5018 did not change this behavior. In order to upgrade an index table to PHOENIX-5156 (new index design), we need to rebuild all the rows that are created before the table is upgraded (not before the timestamp of the index table). Also, we may want to use the IndexTool rebuild an index table online. In that case, we may want include as many rows as possible. This issue is to make sure that IndexTool builds all the rows that exist at the time the tool starts running. 

Issue Links

• links to: GitHub Pull Request #591