Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-5342

[Format] Formalize extension type metadata in IPC protocol

    XMLWordPrintableJSON

    Details

      Description

      On the heels of ARROW-585 and ARROW-5255, it has been proposed to add reserved keys to custom_metadata on the Field Flatbuffer type to pass along the name of a custom/user-defined data type and any serialized data required to reconstruct that data type.

      The objective of this is to enable library users to define new data types that are embedded semantically in pre-defined Arrow data types like Binary or FixedSizeBinary. For example, UUID could be defined as an extension type atop FixedSizeBinary(16) (though UUID may be important enough to formalize as a logical type at some point...)

      I will propose language to add to Metadata.rst and start a discussion on the mailing list to possibly call a vote

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                wesm Wes McKinney
                Reporter:
                wesm Wes McKinney
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 40m
                  3h 40m