[IMPALA-2494] Impala Unable to scan a Decimal column stored as Bytes

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: Impala 2.3.0
• Fix Version/s: Impala 2.11.0
• Component/s: Backend
• Target Version: Product Backlog
• Assignee: Bikramjeet Vig
• Reporter: Taras Bobrovytsky
• Created: 07/Oct/15 01:24
• Updated: 08/Nov/17 22:22
• Resolved: 08/Nov/17 22:22

Description

The CREATE TABLE LIKE PARQUET statement works on the file attached. However, executing

Select * from table20

causes the following error:

File 'hdfs://localhost:20500/taras/table20.parquet' has an incompatible Parquet schema for column 'taras_tmp.table20.col2'. Column type: DECIMAL(9, 2), Parquet schema:
required byte_array col2 [i:1 d:0 r:0]

This is supported according to the Parquet spec: https://github.com/Parquet/parquet-format/blob/master/LogicalTypes.md#decimal

Issue Links

• relates to: IMPALA-5542 Impala cannot scan Parquet decimal stored as int64_t/int32_t
• relates to: IMPALA-2515 Impala rejects Parquet schemas where decimal fixed_len_byte_array columns have unnecessary padding bytes