[ARROW-15544] [Go][Parquet] pqarrow.getOriginSchema error while decoding ARROW:schema

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 7.0.0
• Fix Version/s: 8.0.0
• Component/s: Go, Parquet
• Labels: pull-request-available
• Environment: go1.17, python3.8
• External issue URL: https://github.com/apache/arrow/issues/31014

Language

Go

• Assignee: Matthew Topol
• Reporter: Antoine Gelloz
• Created: 03/Feb/22 09:58
• Updated: 11/Jan/23 11:37
• Resolved: 21/Mar/22 19:28

Description

Hello !

This is my first time participating in the open source community as a junior developer and I would like to thank you all for your hard work

While using the new pqarrow package for our project Metronlab/bow to read parquet files previously written by Pandas.
An error is returned by function getOriginSchema if the "ARROW:schema" base64 encoded value is ending with padding characters.
This is caused by the use of the RawStdEncoding type that omits padding characters.
Is there any reason for using raw encoding instead of standard?

Here is a repo with a test script to demonstrate the problem: antoinegelloz/arrowparquet

Thank you in advance for your help,

Antoine Gelloz

Issue Links

• links to: GitHub Pull Request #12679