Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-1860

[C++] Add data structure to "stage" a sequence of IPC messages from in-memory data

    XMLWordPrintableJSON

Details

    Description

      Currently, when you need to pre-allocate space for a record batch or a stream (schema + dictionaries + record batches), you must make multiple passes over the data structures of interest (and use e.g. MockOutputStream to compute the size of the output buffer). It would be useful to make a single pass to "prepare" the IPC payload for both sizing and writing to prevent having to make multiple passes

      Attachments

        1. text.html
          2 kB
          Brian Bowman

        Issue Links

          Activity

            People

              wesm Wes McKinney
              wesm Wes McKinney
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 0.5h
                  0.5h