Details
-
Improvement
-
Status: Resolved
-
Major
-
Resolution: Fixed
-
Impala 2.8.0, Impala 2.9.0
Description
With IMPALA-4725 we've introduced query options to control the field resolution behavior when scanning Parquet files with nested arrays. The current default strategy currently tries to auto-detect the array encoding within Parquet files, but this strategy can sometimes subtly go wrong and return incorrect results due to the inherent ambiguity of the 2/3-level encoding schemes in Parquet.
We should switch the default resolution strategy according to the Parquet standard 3-level encoding, instead of the current auto-detect.
Attachments
Issue Links
- breaks
-
IMPALA-6489 ASAN use-after-poison in impala::HdfsScanner::InitTupleFromTemplate
- Resolved