[PHOENIX-5957] Index rebuild should remove old index rows with higher timestamp

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 5.0.0, 4.14.3
• Fix Version/s: 4.16.0
• Assignee: Kadir OZDEMIR
• Reporter: Kadir OZDEMIR
• Created: 15/Jun/20 21:54
• Updated: 03/Sep/20 21:44
• Resolved: 03/Sep/20 21:44

Description

During the upgrade of index tables from the old design to the new design, we rebuild the index table rows online. Rebuilding index table rows using the new design is supposed to be overwriting the old index rows. Due to a bug in the old implementation of the index tool (fixed by PHOENIX-5018), the old index row likely have higher timestamps than their data table rows. Since the current implementation of the index tool correctly sets the index row timestamps using the data table row timestamps, newly rebuilt index rows become older versions of the old index rows. So, essentially they do not overwrite old index rows. This does not cause correctness issue as the old rows are repaired by the read repair feature of the new design but increases the number of read repair operations, and thus, causes performance issues.

Issue Links

• is part of: PHOENIX-6067 (5.x) Global Secondary Index Parity with 4.x
• links to: PR