Uploaded image for project: 'Apache Arrow'
  1. Apache Arrow
  2. ARROW-17825

[C++] Allow to write several tables successively with ORCFileWriter::Write method

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 11.0.0
    • C++

    Description

      I had the need to write an ORC file little by little, so as to not consume too much memory.
      Following this discussion, it appeared that the API did not seemed to prevent doing that, but that the internal implementation was not reusing the writer accordingly.

      This PR makes the needed changes to reuse the "writer_" correctly.

      I do not think that the preceding behaviour was correct, as calling several time the "Write" method would lead to incorrect ORC files.

      Attachments

        Issue Links

          Activity

            People

              louisc Louis Calot
              louisc Louis Calot
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 50m
                  3h 50m