[PARQUET-1322] Statistics is not available for DECIMAL types

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 1.9.0, 1.10.0
• Labels: pull-request-available
• Assignee: Vlad Rozov
• Reporter: Vlad Rozov
• Created: 10/Jun/18 17:19
• Updated: 05/Nov/18 21:54

Description

According to parquet format specification columns annotated as DECIMAL should use SIGNED comparator and statistics should be available. The sort order returned by org.apache.parquet.format.converter.ParquetMetadataConverter for DECIMAL is SortOrder.UNKNOWN which contradicts the specification and makes statistics for DECIMAL types unavailable.

Issue Links

• is caused by: PARQUET-686 Allow for Unsigned Statistics in Binary Type
• links to: Decimal format specification
• links to: GitHub Pull Request #494