Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-6107

[Go] ipc.Writer Option to skip appending data buffers

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • None
    • None
    • Go
    • None

    Description

      For cases where we have a known shared memory region, it would be great if the ipc.Writer (and by extension ipc.Reader?) had the ability to write out everything but the actual buffers holding the data. That way we can still utilize the ipc mechanisms to communicate without having to serialize all the underlying data across the wire.

       

      This seems like it should be possible since the `RecordBatch` flatbuffers only contain the metadata and the underlying data buffers are appended later. We just need to skip appending the underlying data buffers.

       

      sbinet thoughts?

      Attachments

        Activity

          People

            Unassigned Unassigned
            nickpoorman Nick Poorman
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: