Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-8719

Stream data easily- function to convert record batch to streamable format

    XMLWordPrintableJSON

    Details

    • Type: Wish
    • Status: Closed
    • Priority: Minor
    • Resolution: Information Provided
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: C
    • Environment:
      Linux

      Description

      I am currently working on a project that  need to send the data in different processes. Instead of storing it in a file, I am using the IPC stream method, storing it into a buffer. When I try to send the data(bytes) through a socket, I loose the data in the client side. ( Which gives me the idea that when i leave the function(create buffer in the server side folder), I loose acces to that data. Can there be an example that explains this.

      Also, can you implement a function that convert the record batch into the format that can be sent through the socket directly.

       

      The code are in the attachment, one for the server side code and the other for the client side code.

      Thank you

        Attachments

        1. code.zip
          133 kB
          Steven

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              steven566 Steven
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: