[DRILL-5504] Vector validator to diagnose offset vector issues

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.10.0
• Fix Version/s: 1.11.0
• Labels: ready-to-commit
• Assignee: Paul Rogers
• Reporter: Paul Rogers
• Created: 10/May/17 23:38
• Updated: 03/Jun/17 04:52
• Resolved: 03/Jun/17 04:52

Description

DRILL-5470 describes a case in which an offset vector appears to have become corrupted, yielding a bogus field-length value that is orders of magnitude larger than the vector that contains the data.

Debugging such cases is slow and tedious. To help, we propose to create a "vector validator" that spins through vectors looking for problems.

Then, to allow the validator to be used in the field, extend the "iterator validator batch iterator" to optionally allow vector validation on each batch.

Issue Links

• is related to: DRILL-5526 Refactor, extend vector validator with remaining types
• relates to: DRILL-5526 Refactor, extend vector validator with remaining types
• links to: GitHub Pull Request #832