Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-1509

[Python] Write serialized object as a stream of encapsulated IPC messages

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • 2.0.0
    • Python
    • None

    Description

      The structure of the stream in arrow::py::WriteSerializedObject is generated on an ad hoc basis – the components of the stream would be easier to manipulate if this were internally a generic stream of IPC messages. For example, one would be able to examine only the union that represents the structure of the serialized payload and leave the tensors undisturbed

      Attachments

        Issue Links

          is related to

          New Feature - A new feature of the product, which has yet to be developed. ARROW-1783 [Python] Convert SerializedPyObject to/from sequence of component buffers with minimal memory allocation / copying

          • Major - Major loss of function.
          • Resolved
          is superceded by

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-9518 [Python] Deprecate pyarrow serialization

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              Unassigned Unassigned
              wesm Wes McKinney
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: