[ARROW-3479] [R] Support to write record_batch as stream

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.0
• Component/s: R
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/19798
• Assignee: Javier Luraschi
• Reporter: Javier Luraschi
• Created: 09/Oct/18 22:44
• Updated: 11/Jan/23 07:27
• Resolved: 10/Oct/18 11:48

Description

Currently, one can only export a record batch to a file:

record <- arrow::record_batch(data.frame(a = c(1,2,3)))
record$to_file()

But to improve performance in Spark's R bindings through sparklyr an improvement is to support streams returning R raw's as follows:

record <- arrow::record_batch(data.frame(a = c(1,2,3)))
record$to_stream()

Issue Links

• links to: GitHub Pull Request #2727