[DRILL-8109] Drill can not read parquet timestamp type with logical type in hive storage plugin

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.19.0
• Component/s: Storage - Hive

Environment

drill 1.19.0
hive 3.12

• Assignee: Cong Luo
• Reporter: cdmikechen
• Created: 20/Jan/22 00:39
• Updated: 02/Mar/22 10:14
• Resolved: 02/Mar/22 10:14

Description

Parquet timestamp int96 had been deprecated.
https://github.com/apache/parquet-format/pull/86/files

Many computing engines that support parquet reading (such as Hive4, Hudi, Spark and so on) can use Int64 as the time storage type. When using these computing engines to read parquet files, we should also support long data type reading.

We should support int64 with logical type timestamp by hive storage.