[DRILL-7948] Unable to query file with required fixed_len_byte_array decimal columns

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 1.18.0, 1.19.0
• Fix Version/s: 1.20.0
• Component/s: Storage - Parquet

Environment

Docker: master

Sys.Version: 

1.19.0-SNAPSHOT

82c03e44eac3863a10e599d8f2068fc58e986041

 

• Assignee: Vova Vysotskyi
• Reporter: Nick Stenroos-Dam
• Reviewer: Vitalii Diravka
• Created: 04/Jun/21 08:42
• Updated: 16/Jun/21 17:31
• Resolved: 16/Jun/21 17:31

Description

When attempting to query a file with required fixed_len_byte_array decimal columns, the exception: INTERNAL_ERROR ERROR: Error in drill parquet reader is thrown

Full Exception:

 

{{org.apache.drill.common.exceptions.UserRemoteException: INTERNAL_ERROR ERROR: Error in drill parquet reader (complex). Message: Failure in setting up reader Parquet Metadata: ParquetMetaData{FileMetaData{schema: message schema
{ required fixed_len_byte_array(16) Sale (DECIMAL(29,6)); required fixed_len_byte_array(16) Cost (DECIMAL(29,6)); }
, metadata: {}}, blocks: [BlockMetaData{1, 260 [ColumnMetaData
{SNAPPY [Sale] required fixed_len_byte_array(16) Sale (DECIMAL(29,6)) [RLE, PLAIN, PLAIN_DICTIONARY], 36}
, ColumnMetaData
{SNAPPY [Cost] required fixed_len_byte_array(16) Cost (DECIMAL(29,6)) [RLE, PLAIN, PLAIN_DICTIONARY], 292}
]}]} Fragment: 0:0 Please, refer to logs for more information. [Error Id: 772dfd77-1eaf-4cbc-9b7b-4d4a1e5c3080 on 67732da24351:31010]}}

 

Test Query:

select * from data.`SingleRow_RequiredFixedLength_Decimal.parquet`

Test File:

https://projectbiaps-my.sharepoint.com/:u:/g/personal/nisd_project_bi/ET-9G1pyXmJGm6AaLv9BTMsBBInk-EuvFRWEeA-gAqXDwQ?e=wkAH7H