[ARROW-14634] [Format] Define looser version of record batch

• Type: New Feature
• Status: In Progress
• Priority: Minor
• Resolution: Unresolved
• Component/s: Format
• Labels: pull-request-available
• External issue URL: https://github.com/apache/arrow/issues/30178
• Assignee: Unassigned
• Reporter: Nate Bauernfeind
• Created: 08/Nov/21 21:58
• Updated: 11/Jan/23 08:41

Description

It would be nice to support a version of RecordBatch where:

• columns can be omitted from the flatbuffer metadata (we can already skip the payload by sending a Buffer of length 0)
• each Column may have independent lengths

Issue Links

• links to: GitHub Pull Request #11646