[ARROW-6340] [R] Implements low-level bindings to Dataset classes

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.16.0
• Component/s: C++, R
• Labels: dataset pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/22717
• Assignee: Neal Richardson
• Reporter: Francois Saint-Jacques
• Created: 23/Aug/19 21:17
• Updated: 11/Jan/23 07:46
• Resolved: 08/Nov/19 19:23

Description

The following classes should be accessible from R:

• class DataSource
• class DataSourceDiscovery
• class Dataset
• class ScanContext, ScanOptions, ScanTask
• class ScannerBuilder
• class Scanner

The end result is reading a directory of parquet files as a single stream. One should be able to re-implement https://github.com/apache/arrow/pull/5720 in R. 

See also https://github.com/apache/arrow/pull/5675/files for another end-to-end example in C++.

Issue Links

• depends upon: ARROW-6242 [C++] Implements basic Dataset/Scanner/ScannerBuilder
• links to: GitHub Pull Request #5454