[PARQUET-2] Adding Type Persuasion for Primitive Types

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: parquet-mr
• Assignee: Daniel Weeks
• Reporter: Daniel Weeks
• Created: 19/Jun/14 21:04
• Updated: 07/Apr/15 20:45
• Resolved: 24/Jun/14 17:20

Description

Pull request: https://github.com/apache/incubator-parquet-mr/pull/3
Original from the old repo: Parquet/parquet-mr#410

These changes allow primitive types to be requested as different types than what is stored in the file format using a flag to turn off strict type checking (default is on). Types are cast to the requested type where possible and will suffer precision loss for casting where necessary (e.g. requesting a double as an int).

No performance penalty is imposed for using the type defined in the file type. A flag exists to

A 6x6 test case is provided to test conversion between the primitive types.