[AVRO-3630] [Rust] Make it possible to extend pre-existing Avro bytes

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.11.1
• Fix Version/s: 1.12.0, 1.11.2
• Component/s: rust
• Labels: pull-request-available
• Assignee: Martin Tzvetanov Grigorov
• Reporter: Martin Tzvetanov Grigorov
• Created: 27/Sep/22 12:42
• Updated: 11/Oct/22 10:45
• Resolved: 28/Sep/22 08:36

Description

From ASF Slack #[avro|https://the-asf.slack.com/archives/CLUD54M1S/p1663751850569319:]

===================================

 I'm currenlty solving it by reading the original file and appending it to a new Vec

let bytes: Vec<u8> = object_store
                                .get(&old_manifest_location)
                                .await?
                                .bytes()
                                .await?
                                .into();

let mut writer = apache_avro::Writer::new(&schema, Vec::new());

let reader = apache_avro::Reader::new(&*bytes)?;
writer.extend(reader.filter_map(Result::ok))?;

writer.append_ser(entry)?;
let new_bytes = writer.into_inner()?;

I was wondering if I could do something like:

let bytes: Vec<u8> = object_store
                                .get(&old_manifest_location)
                                .await?
                                .bytes()
                                .await?
                                .into();

let mut writer = apache_avro::Writer::new(&schema, bytes);

writer.append_ser(entry)?;

let new_bytes = writer.into_inner()?;

==================================

Issue Links

• links to: GitHub Pull Request #1888