[BEAM-14236] [Python] Write to Parquet support for list to conform with Apache Parquet specification

• Type: Bug
• Status: Resolved
• Priority: P2
• Resolution: Fixed
• Fix Version/s: Not applicable
• Component/s: io-py-parquet
• Flags: Patch
• Assignee: Shivraj Devidas Wabale
• Reporter: Shivraj Devidas Wabale
• Created: 02/Apr/22 21:56
• Updated: 08/Apr/22 20:27
• Resolved: 08/Apr/22 20:27

Description

ARROW-11497 The pyarrow parquet writer now support the list type contains 3 level where the middle level, named list, must be a repeated group with a single field named element. https://github.com/apache/parquet-format/blob/master/LogicalTypes.md#lists

I think we can simply populate it to WriteToParquet by adding additional flag (use_compliant_nested_type) to 
 conform with Apache Parquet specification.

Issue Links

• links to: GitHub Pull Request #17279