Details
-
Improvement
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
Description
The Arrow Substrait consumer does not currently support functions on intervals. This is because the Substrait deserializer currently asserts that all information must be round trippable and it errs on the side of rejecting plans before allowing a plan that could be correct consumed but not round tripped.
This affects interval types because, for example, the substrait interval 1 year 12 months would be converted to the substrait interval 2 years after a round trip.
To resolve this the current implementation encodes intervals as fixed length lists of numbers which we cannot do any kind of temporal math on.
Attachments
Issue Links
- depends upon
-
ARROW-16988 [C++] Introduce Substrait ToProto/FromProto conversion options
- Resolved