[ARROW-9758] [Rust] [DataFusion] Implement extension API for DataFusion

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Rust, Rust - DataFusion
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/25810
• Assignee: Andy Grove
• Reporter: Andy Grove
• Created: 16/Aug/20 15:30
• Updated: 11/Jan/23 08:08
• Resolved: 16/Aug/20 18:51

Description

I would like the ability to extend DataFusion by providing my own:

• Logical plan optimization rules
• Physical query planner for converting logical plan to physical plan

Later, I would also like to be able to provide physical plan optimization rules but we don't have a physical optimizer yet.

These changes would allow people to extend DataFusion easily without implementing their own competing DataFrame APIs.

Issue Links

• is duplicated by: ARROW-9732 [Rust] [DataFusion] Add "Physical Planner" type thing which can do optimizations
• links to: GitHub Pull Request #7975