Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-1089

[C++/Python] Add API to write an Arrow stream into either the stream or file formats on disk

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 1.0.0
    • Component/s: C++, Python
    • Labels:

      Description

      For Arrow streams with unknown size, it would be useful to be able to write the data to disk either as a stream or as the file format (for random access) with minimal overhead; i.e. we would avoid record batch IPC loading and write the raw messages directly to disk

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              wesm Wes McKinney
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: