[ARROW-12284] [Rust] [DataFusion] Review the contract between DataFusion and Arrow

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Invalid
• Component/s: Rust - DataFusion
• External issue URL: https://github.com/apache/arrow/issues/28090
• Assignee: Unassigned
• Reporter: Andy Grove
• Created: 07/Apr/21 21:47
• Updated: 11/Jan/23 08:25
• Resolved: 26/Apr/21 13:33

Description

I am creating this issue based on the discussion at the sync call earlier today.

Apparently DataFusion is not only using the high-level Arrow API but is also accessing Arrow internals directly and this would be one challenge in moving to a majorly refactored Arrow implementation.

Perhaps we need to review what the public Arrow API should be and which APIs DataFusion should or should not be using.