[AVRO-3405] add API for user-provided metadata when writing to Object Container File

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.11.0
• Fix Version/s: 1.11.1, 1.12.0
• Component/s: rust
• Labels: pull-request-available

Environment

Rust Edition 2021

avro-rs = "0.13.0"

 

• Assignee: Martin Tzvetanov Grigorov
• Reporter: Kevin
• Created: 16/Feb/22 02:58
• Updated: 17/Feb/22 20:39
• Resolved: 17/Feb/22 20:39

Description

Other libraries provide an API for user-specified metadata to be written to the header of an Avro Object Container File. In our case we have always done this from Python but are now implementing new projects in Rust. This is important to our use of Avro as the metadata provides critical context for data handling from container files.

As an example in Rust, see the avrow crate which provides this facility as a method on its WriterBuilder. Something similar for avro-rs would suit our needs.

For a variety of reasons we are unable to use avrow in our Rust development, so we need this Improvement in Apache avro-rs.

Thank you for your consideration!

Issue Links

• links to: GitHub Pull Request #1551