Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-978

[C++] Minimizing footer reads for small(ish) metadata

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • cpp-1.2.0
    • parquet-cpp
    • None

    Description

      Other Parquet implementations will do a read from the end of the file (e.g. 64K) in case a single read suffices to obtain the metadata, metadata size, and magic end bytes. We don't do this yet: https://github.com/apache/parquet-cpp/blob/master/src/parquet/file/reader-internal.cc#L251

      Attachments

        Activity

          People

            mdeepak Deepak Majeti
            wesm Wes McKinney
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: