[PARQUET-1870] Handle INT96 more gracefully in parquet-avro

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 1.11.0
• Component/s: parquet-avro
• Assignee: Unassigned
• Reporter: Ben Watson
• Created: 05/Jun/20 21:42
• Updated: 23/Jun/24 03:31
• Resolved: 08/Jun/20 09:52

Description

The parquet-avro library does not support INT96 columns (PARQUET-323), and any attempt to process a file containing such a column results in:

throw new IllegalArgumentException("INT96 not implemented and is deprecated");

INT96 is still used in many legacy datasets, and so it would be useful to be able to process Parquet files containing these records, even if the INT96 values themselves aren't rendered.

The same functionality has already been re-added into parquet-pig (PARQUET-1133).