Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-485

Decouple data page delimiting from column reader / scanner classes, create test fixtures

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • cpp-1.0.0
    • parquet-cpp
    • None

    Description

      It is difficult to test the column reader classes with mock data because the data page resolution is tightly coupled to the actual file format layout in ColumnReader::ReadNewPage.

      I plan to separate these concerns, so that the column readers can be tested with a sequence of data pages encoded in memory, but never actually assembled into a file stream layout with thrift-serialized page headers. Patch forthcoming.

      Attachments

        Activity

          People

            wesm Wes McKinney
            wesm Wes McKinney
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: