[ARROW-11803] [Rust] [Parquet] Support v2 LogicalType

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0
• Component/s: Rust
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/27654
• Assignee: Neville Dipale
• Reporter: Neville Dipale
• Created: 27/Feb/21 08:41
• Updated: 11/Jan/23 08:22
• Resolved: 07/Mar/21 19:09

Description

We currently do not read nor write the version 2 logical types. This is mainly because we do not have a mapping for it from parquet-format-rs.

To implement this, we can:

• convert "parquet::basic::LogicalType" to "parquet::basic::ConvertedType"
• implement "parquet::basic::LogicalType" which mirrors "parquet_format::LogicalType"
• create a mapping between ConvertedType and LogicalType
• write LogicalType to "parquet_format::SchemaElement" if v2 of the writer is used

This would be a good starting point for implementing 2.6 types (UUID, NANOS precision time & timestamp).
Follow-up work would be:

• parsing v2 of the schema ARROW-11365
• Using v2 in the Arrow writer (mostly schema conversion)
• Supporting nanosecond precision time & timestamp

Issue Links

• links to: GitHub Pull Request #9592