Details
-
Improvement
-
Status: Resolved
-
Minor
-
Resolution: Fixed
-
None
Description
The parquet-format FileMetaData struct contains optional key value pairs with additional metadata about the schema:
https://docs.rs/parquet-format/2.6.0/src/parquet_format/parquet_format.rs.html#3821
When the parquet file was generated using the java avro parquet writer, this for example contains the original avro schema under the `parquet.avro.schema` or `avro.schema` keys.
It would be nice if this metadata was accessible through the `arrow::datatypes::Schema.metadata` field.
I'm willing to implement and create a pull request for this feature.
Attachments
Issue Links
- links to