Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-13542

[C++][Compute][Dataset] Add dataset::WriteNode for writing rows from an ExecPlan to disk

    XMLWordPrintableJSON

Details

    Description

      This will serve as a sink ExecNode which dumps all the batches it receives to disk. The PR should probably also replace FileSystemDataset::Write with an ExecPlan based implementation

      Attachments

        Issue Links

          is a child of

          New Feature - A new feature of the product, which has yet to be developed. ARROW-12633 [C++] Query engine umbrella issue

          • Major - Major loss of function.
          • Open
          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. ARROW-14191 [C++][Dataset] Dataset writes should respect backpressure

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. ARROW-13554 [C++] Remove deprecated Scanner::Scan

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link GitHub Pull Request #11017

          There are no Sub-Tasks for this issue.

          Activity

            People

              westonpace Weston Pace
              bkietz Ben Kietzman
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 13h 20m
                  13h 20m