[ARROW-17627] [GO][Parquet] Unable to pass metadata without StoreSchema

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 9.0.0
• Fix Version/s: 10.0.0
• Component/s: Go, Parquet
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/20399
• Assignee: Matthew Topol
• Reporter: Yan Zhou
• Created: 06/Sep/22 10:13
• Updated: 11/Jan/23 11:52
• Resolved: 09/Sep/22 21:18

Description

https://github.com/apache/arrow/blob/master/go/parquet/pqarrow/file_writer.go#L75

 

Right now the only way to pass in KV metadata is to enable StoreSchema and pass it as part of the schema. In otherwise we can't pass through metadata without also store ARROW:schema

 

I suggest change it to the following

 

	meta := make(metadata.KeyValueMetadata, 0)
	for i := 0; i < arrschema.Metadata().Len(); i++ {
		meta.Append(arrschema.Metadata().Keys()[i], arrschema.Metadata().Values()[i])
	}

	if arrprops.storeSchema {

		serializedSchema := flight.SerializeSchema(arrschema, props.Allocator())
		meta.Append("ARROW:schema", base64.StdEncoding.EncodeToString(serializedSchema))
	}

 

Issue Links

• links to: GitHub Pull Request #14087