[IMPALA-5628] Parquet support for additional valid decimal representations

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: Impala 4.1.0
• Component/s: Backend
• Labels: ramp-up
• Target Version: Product Backlog
• Epic Color: ghx-label-7
• Assignee: Zoltán Borók-Nagy
• Reporter: Tim Armstrong
• Created: 07/Jul/17 16:46
• Updated: 28/Mar/23 15:44
• Resolved: 20/Jul/21 14:55

Description

This is an umbrella JIRA to implement valid representations of DECIMAL that Impala doesn't currently support.

See https://github.com/Parquet/parquet-format/blob/master/LogicalTypes.md

Sub-Tasks

• Impala rejects Parquet schemas where decimal fixed_len_byte_array columns have unnecessary padding bytes: Resolved
• Impala Unable to scan a Decimal column stored as Bytes: Resolved
• Impala cannot scan Parquet decimal stored as int64_t/int32_t: Resolved
• Impala is unable to read Parquet decimal columns with lower precision/scale than table metadata: Resolved
• Impala is unable to read Parquet decimal columns with higher scale than table metadata: Resolved