Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1047

Anyway to write empty row group?

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • cpp-1.1.0
    • cpp-1.1.0
    • parquet-cpp
    • None

    Description

      [Error]
      So I'm trying to write only header information (column names and such).

      parquet::RowGroupWriter* rg_writer =
                      file_writer->AppendRowGroup(0);
      for (i = 0; i < Cols; i++){
      parquet::BoolWriter* writer = static_cast<parquet::BoolWriter*>(rg_writer->NextColumn());
      writer->WriteBatch(0, nullptr, nullptr, nullptr);
      }
      

      The problem is that when trying to close the file_writer, the program throws:

      Parquet what error: Parquet Write error: Column 3 is not complete.
      

      [Possbility]
      I know this is possible because as per this post an empty row group was written to the back.

      Tho the problem was present in parquet-mr instead of parquet-cpp, I guess it's fair to expect some feature like that.

      Or maybe I don't fully understand how the system works.... would be great if you guys can point out where to look it : D

      Attachments

        Activity

          People

            Unassigned Unassigned
            elderrex yugu
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: