[ARROW-7622] [Format] Mark Tensor and SparseTensor fields required

• Type: Wish
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.15.1
• Fix Version/s: 0.16.0
• Component/s: Format
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/23875
• Assignee: Antoine Pitrou
• Reporter: Antoine Pitrou
• Created: 20/Jan/20 19:11
• Updated: 11/Jan/23 07:54
• Resolved: 23/Jan/20 19:41

Description

The Tensor and SparseTensor parts of the format are currently marked experimental. This presumably means that they are still allowed to change (and indeed they did change one month ago, in ARROW-4225).

I suggest we take the opportunity to mark some fields required in Tensor.fbs and SparseTensor.fbs, to make input validation more robust.

cc mrkn, jacques and wesm for opinions.

Issue Links

• links to: GitHub Pull Request #6234