Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1022

[C++] Append mode in parquet-cpp

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • cpp-1.1.0
    • None
    • parquet-cpp
    • None

    Description

      As said, currently trying to work out a append feature for parquet files in c++.
      (been searching through repo etc, can't find example tho..)

      Current solution is to (assume no schema changes that is):

      Read in metadata
      Change metadata based on appended rows+ original rows
      Append a new row group (or multiple row group writer)
      Write the new rows.


      The problem is that, is approached this way, the original last row group may not be complete filled. Was wondering if there is a fix or I'm using the api wrong...

      Thanks ! : D

      Attachments

        Activity

          People

            wesm Wes McKinney
            elderrex yugu
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: