[ARROW-11195] [Rust] [DataFusion] Built-in table providers should expose relevant fields

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 3.0.0
• Component/s: Rust - DataFusion
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/27100
• Assignee: Andy Grove
• Reporter: Andy Grove
• Created: 09/Jan/21 20:39
• Updated: 11/Jan/23 08:18
• Resolved: 09/Jan/21 22:30

Description

For projects that depend on the DataFusion logical plan, there is a breaking change currently compared to 2.0.0 where it is not possible to introspect the TableScan node for CSV and Parquet files to get the file path and other meta-data (such as delimiter for CSV).

I propose adding public methods to the specific providers so that other crates can downcast to specific implementations in order to access this data.

My specific use case is the ability to serialize a DataFusion logical plan.

Issue Links

• links to: GitHub Pull Request #9149