Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-1422

[Format] Add specification document for the serialization scheme used in Python

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 1.0.0
    • Component/s: Format, Python
    • Labels:
      None

      Description

      In discussing the new pyarrow.serialize function with attendees at JupyterCon last week, there is some interest in possibly using this serialization scheme (a union with scalar values + object structure, with a sidecar of tensors) beyond Python. For example, it would be interesting to be able to interact with this "data structure" in JavaScript. It may be worth writing down the details of how this works so that other implementations can be created without having to pore through the C++ code for details

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              wesmckinn Wes McKinney
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: