[SQOOP-3377] True Parquet Decimal Support

• Type: Improvement
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 1.4.7
• Fix Version/s: 3.0.0
• Assignee: Fero Szabo
• Reporter: Fero Szabo
• Created: 31/Aug/18 11:34
• Updated: 11/Dec/18 13:36

Description

Currently, fixed point numbers (decimal, number) are stored as a String when imported to parquet. This Jira is about adding the capability to store them as logical types (as we do in avro).

The parquet library might have to be upgraded.

Issue Links

• incorporates: SQOOP-3418 Document decimal support in Hive external import into parquet files

Sub-Tasks

• Upgrade the Parquet library from 1.6.0 to 1.9.0: Resolved
• Add parquet numeric support for Parquet in hdfs import: Resolved
• Refactor: break up Parameterized tests on a per database basis: Resolved
• Add parquet numeric support for Parquet in Hive import: Resolved