Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-612

Add compression to FileEncodingIT tests

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.9.0, 1.8.2
    • Component/s: parquet-mr
    • Labels:
      None

      Description

      The FileEncodingsIT test validates that pages can be read independently with all encodings, without compression. Pages should not depend on one another for compression to be correct as well, so we should extend this test to use the other compression codecs.

      This test is already expensive, so I propose adding an environment variable to add more compression codecs. That way this results in no extra build/test time, but we can turn on more validation in Travis CI.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                rdblue Ryan Blue
                Reporter:
                rdblue Ryan Blue
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: