[ARROW-15933] [C++] Add ability for users to add Substrait consumable custom file format support

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: C++
• Labels: substrait
• External issue URL: https://github.com/apache/arrow/issues/31361
• Assignee: Unassigned
• Reporter: Weston Pace
• Created: 14/Mar/22 20:14
• Updated: 11/Jan/23 11:40

Description

The datasets API currently allows users to plug in their own file formats. The Substrait consumer only allows parquet & IPC. There is an open Substrait issue to make the file format extensible: https://github.com/substrait-io/substrait/issues/138

Once that feature is added we will need some kind of extension point in our Substrait consumer so that users can register their file format accordingly.