Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Duplicate
-
None
Description
Following ARROW-13542. Any query that has a join or an aggregation currently has to first evaluate the query and hold it in memory before creating a Scanner to write it. We could improve that by using a WriteNode inside write_dataset() (and maybe that improves the other cases too, or at least allows us to delete some code).
Attachments
Issue Links
- duplicates
-
ARROW-15517 [R] Use WriteNode in write_dataset()
- Resolved