Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-21388

Parquet DECIMAL logical type is not properly supported in ParquetSchemaConverter

    XMLWordPrintableJSON

    Details

      Description

      For a parquet field such as this oneĀ 

      optional int32 ss_wholesale_cost (DECIMAL(7,2));

      ParquetSchemaConverter raises the exception:

      Unsupported original type : DECIMAL for primitive type INT32

      whereas it should be mapped to flink DECIMAL Datatype (BIG_DEC type information) owing to https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/connectors/formats/parquet.html#data-type-mapping
      and https://ci.apache.org/projects/flink/flink-docs-stable/dev/table/types.html#old-planner

        Attachments

          Activity

            People

            • Assignee:
              echauchot Etienne Chauchot
              Reporter:
              echauchot Etienne Chauchot
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: