[ARROW-16966] [Doc] Document Substrait conformance

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 9.0.0
• Component/s: C++, Documentation
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/32283
• Assignee: Weston Pace
• Reporter: Weston Pace
• Created: 02/Jul/22 01:34
• Updated: 11/Jan/23 11:47
• Resolved: 11/Jul/22 16:02

Description

Acero will never have 100% Substrait conformance. To begin with there will be a number of features that we simply have not yet implemented. In the future there will likely still be some features that we never implement (e.g. Acero is likely to be a rather simple producer and will reject most "plan shorthand").

In the future we will hopefully have a way of expressing this programmatically. However, this hasn't been figured out by Substrait yet. In the meantime we should clearly document which parts of Substrait we do and do not support.

Issue Links

• links to: GitHub Pull Request #13494