[ARROW-1961] [Python] Writing Parquet file with flavor='spark' loses pandas schema metadata

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.9.0
• Component/s: Python
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/17949
• Assignee: Wes McKinney
• Reporter: Wes McKinney
• Created: 02/Jan/18 18:38
• Updated: 11/Jan/23 07:18
• Resolved: 25/Jan/18 22:17

Description

You can see the issue in the _sanitize_schema method

https://github.com/apache/arrow/blob/master/python/pyarrow/parquet.py#L201

see https://github.com/apache/arrow/issues/1452

Issue Links

• links to: GitHub Pull Request #1511