[DRILL-4764] Parquet file with INT_16, etc. logical types not supported by simple SELECT

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.10.0
• Component/s: Execution - Data Types
• Assignee: Serhii Harnyk
• Reporter: Paul Rogers
• Reviewer: Rahul Kumar Challapalli
• Created: 04/Jul/16 20:18
• Updated: 18/Jun/18 14:04
• Resolved: 30/Jan/17 19:46

Description

Create a Parquet file with the following schema:

message int16Data

{ required int32 index; required int32 value (INT_16); }

Store it as int_16.parquet in the local file system. Query it with:

SELECT * from `local`.`root`.`int_16.parquet`;

The result, in the web UI, is this error:

org.apache.drill.common.exceptions.UserRemoteException: SYSTEM ERROR: UnsupportedOperationException: unsupported type: INT32 INT_16 Fragment 0:0 [Error Id: c63f66b4-e5a9-4a35-9ceb-546b74645dd4 on 172.30.1.28:31010]

The INT_16 logical (or "original") type simply tells consumers of the file that the data is actually a 16-bit signed int. Presumably, this should tell Drill to use the SmallIntVector (or NullableSmallIntVector) class for storage. Without supporting this annotation, even 16-bit integers must be stored as 32-bits within Drill.

Issue Links

• incorporates: DRILL-4217 Query parquet file treat INT_16 & INT_8 as INT32
• links to: GitHub Pull Request #673