[ARROW-8318] [C++][Dataset] Dataset should instantiate Fragment

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: C++
• Labels: dataset pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/24506
• Assignee: Francois Saint-Jacques
• Reporter: Francois Saint-Jacques
• Created: 02/Apr/20 20:45
• Updated: 11/Jan/23 10:59
• Resolved: 03/May/20 16:00

Description

Fragments are created on the fly when invoking a Scan. This means that a lot of the auxilliary/ancilliary data must be stored by the specialised Dataset, e.g. the FileSystemDataset must hold the path and partition expression. With the venue of more complex Fragment, e.g. ParquetFileFragment, more data must be stored.

Issue Links

• is blocked by: ARROW-8065 [C++][Dataset] Untangle Dataset, Fragment and ScanOptions
• links to: GitHub Pull Request #7073