[ARROW-11718] [Rust] IPC writers shouldn't implicitly finish on drop

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Fix Version/s: 3.0.1, 4.0.0
• Component/s: Rust
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/27577
• Assignee: Steven Fackler
• Reporter: Steven Fackler
• Created: 20/Feb/21 17:58
• Updated: 11/Jan/23 08:21
• Resolved: 24/Feb/21 13:33

Description

The Rust IPC writer types have a destructor that automatically writes the footer if necessary. This is not ideal, though, since it can hide errors. For example, if a web server is streaming data to a client in the Arrow IPC format and it encounters an internal error trying to generate the next batch, the outbound stream will appear valid to the client as the footer will automatically be written out but some amount of data will actually be missing. If the footer was not automatically written, the client would properly detect the truncation.

For reference, the C++ implementation does not attempt to write the footer implicitly on drop.

Issue Links

• links to: GitHub Pull Request #9536