[PHOENIX-5951] IndexTool output logging for past-max-lookback rows should be configurable

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.16.0
• Assignee: Geoffrey Jacoby
• Reporter: Geoffrey Jacoby
• Created: 11/Jun/20 17:33
• Updated: 03/Sep/20 21:42
• Resolved: 29/Jun/20 22:46

Description

On a global mutable table with lots of writes, it can be possible for there to be many rows flagged by index verification as invalid that are older than the max lookback age. These are likely due to race conditions between compaction in the base table and index table, but they can possibly show real issues.

Since heavy output logging to PHOENIX_INDEX_TOOL can cause hotspotting, some operators may want to turn it off for this class of failures, while still wanting output logging for other kinds of invalid rows.

As part of this change, we should start including in the output row a column with a code identifying the type of error.

Issue Links

• contains: PHOENIX-5930 Index Verification Output should include result error code
• is part of: PHOENIX-6067 (5.x) Global Secondary Index Parity with 4.x