[ARROW-11930] [C++][Dataset][Compute] Refactor Dataset scans to use an ExecNode graph

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 5.0.0
• Component/s: C++
• Labels: compute dataset pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/27767
• Assignee: Ben Kietzman
• Reporter: Ben Kietzman
• Created: 10/Mar/21 22:53
• Updated: 11/Jan/23 08:23
• Resolved: 01/Jul/21 12:15

Description

Per discussion on https://docs.google.com/document/d/1AyTdLU-RxA-Gsb9EsYnrQrmqPMOYMfPlWwxRi1Is1tQ

Once Datasets can be streamed from efficiently (ARROW-7001), they can be wrapped in ScanNodes which push scanned batches into an ExecNode graph.

Filtering and Projection should then be handled by subsequent nodes in that graph.

Issue Links

• is a child of: ARROW-8894 [C++] C++ array kernels framework and execution buildout (umbrella issue)
• is a child of: ARROW-12633 [C++] Query engine umbrella issue
• links to: GitHub Pull Request #10397