Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1372

[C++] Add an API to allow writing RowGroups based on their size rather than num_rows

    XMLWordPrintableJSON

Details

    • Task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • cpp-1.5.0
    • None

    Description

      The current API allows writing RowGroups with specified numbers of rows, however does not allow writing RowGroups with specified size. In order to write RowGroups of specified size we need to write rows in chunks while checking the total_bytes_written after each chunk is written. This is currently impossible because the call to NextColumn() closes the current column writer.

      Attachments

        Issue Links

          Activity

            People

              mdeepak Deepak Majeti
              anatoli.shein Anatoli Shein
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: