[FLINK-21388] Parquet DECIMAL logical type is not properly supported in ParquetSchemaConverter

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.12.3
• Component/s: Formats (JSON, Avro, Parquet, ORC, SequenceFile), Table SQL / Ecosystem
• Labels: pull-request-available
• Assignee: Etienne Chauchot
• Reporter: Etienne Chauchot
• Created: 17/Feb/21 09:47
• Updated: 15/Mar/21 02:33
• Resolved: 15/Mar/21 02:33

Description

For a parquet field such as this one 

optional int32 ss_wholesale_cost (DECIMAL(7,2));

ParquetSchemaConverter raises the exception:

Unsupported original type : DECIMAL for primitive type INT32

whereas it should be mapped to flink DECIMAL Datatype (BIG_DEC type information) owing to https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/connectors/formats/parquet.html#data-type-mapping
and https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/types.html#old-planner

Issue Links

• links to: GitHub Pull Request #14961
• links to: GitHub Pull Request #15172