Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1580

Page-level CRC checksum verification for DataPageV1

Details

    Description

      Now that the specification with respect to page level checksums has been clarified (see https://jira.apache.org/jira/browse/PARQUET-1539), we can actually implement it. What needs to be done:

      • Implement calculating and writing checksums on write path
      • Implement checksum validation on read path
      • Make writing out checksums and validation on reads optional (default off)
      • Implement tests

      Attachments

        Issue Links

          Activity

            People

              bbraams Boudewijn Braams
              bbraams Boudewijn Braams
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Slack

                  Issue deployment