[ARROW-11902] Allow for custom_metadata for Tensor and SparseTensor IPC messages

• Type: Improvement
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: Format
• External issue URL: https://github.com/apache/arrow/issues/27744
• Assignee: Unassigned
• Reporter: ARF
• Created: 08/Mar/21 11:04
• Updated: 11/Jan/23 08:22

Description

The Schema IPC message allows custom_metadata. See here:

It would be great if one could specify similar custom_metadata for Tensor and SparseTensor messages. Currently if one wants to pass the "context/metadata" of a tensor, one has to find out-of-band solutions.

It would be nice, if this could be incorporated into the IPC flow. E.g. one might want to pass a timestamp associated with a tensor indicating when the data was obtained or geographical coordinates indicating the edges of a 2D tensor to locate the data geographically.