[ARROW-15271] [R] Refactor do_exec_plan to return a RecordBatchReader

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 6.0.1
• Fix Version/s: 9.0.0
• Component/s: R
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/30763

Language

R

• Assignee: Neal Richardson
• Reporter: Will Jones
• Created: 06/Jan/22 17:55
• Updated: 11/Jan/23 11:35
• Resolved: 18/May/22 23:27

Description

Right now do_exec_plan returns an Arrow table because head, tail, and arrange do. If ARROW-14289 is completed and similar work is done for arrange, we may be able to alter do_exec_plan to return a RBR instead.

The map_batches() implementation (ARROW-14029) could benefit from this refactor. And it might make ARROW-15040 more useful.

Issue Links

• is related to: ARROW-14029 [R] Repair map_batches()
• is related to: ARROW-15040 [R] Enable write_csv_arrow to take Dataset or arrow_dplyr_query as input
• links to: GitHub Pull Request #13170