[ARROW-9821] [Rust][DataFusion] User Defined PlanNode / Operator API

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Rust, Rust - DataFusion
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/17321
• Assignee: Andrew Lamb
• Reporter: Andrew Lamb
• Created: 21/Aug/20 21:01
• Updated: 11/Jan/23 08:09
• Resolved: 08/Sep/20 13:38

Description

The basic goal is to allow users to implement their own PlanNodes. I will provide a google doc opened for comments shortly.

Proposal: https://docs.google.com/document/d/1IHCGkCuUvnE9BavkykPULn6Ugxgqc1JShT4nz1vMi7g/edit#

See also mailing list discussion here: https://lists.apache.org/thread.html/rf8ae7d1147e93e3f6172bc2e4fa50a38abcb35f046cc5830e09da6cc%40%3Cdev.arrow.apache.org%3E

Issue Links

• links to: GitHub Pull Request #8020
• links to: GitHub Pull Request #8085
• links to: GitHub Pull Request #8097

Sub-Tasks

• [Rust] [DataFusion] Switch from Box<Schema> --> SchemaRef (Arc<Schema>) to be consistent with the rest of Arrow: Resolved
• [Rust][DataFusion] Use Arc<> instead of Box<> in LogicalPlan: Resolved