Uploaded image for project: 'Parquet'
  1. Parquet
  2. PARQUET-1178

Parquet modular encryption

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Done
    • 1.12.0
    • 1.12.0
    • parquet-mr
    • None

    Description

      A mechanism for modular encryption and decryption of Parquet files. Allows to keep data fully encrypted in the storage - while enabling efficient analytics on the data, via reader-side extraction / authentication / decryption of data subsets required by columnar projection and predicate push-down.

      Enables fine-grained access control to column data by encrypting different columns with different keys.

      Supports a number of encryption algorithms, to account for different security and performance requirements.

      Attachments

        Issue Links

          Blocked

          New Feature - A new feature of the product, which has yet to be developed. SPARK-25858 Passing Field Metadata to Parquet

          • Major - Major loss of function.
          • Resolved
          depends upon

          New Feature - A new feature of the product, which has yet to be developed. PARQUET-1300 [C++] Parquet modular encryption

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. PARQUET-1906 CLONE - [C++] Parquet modular encryption

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          New Feature - A new feature of the product, which has yet to be developed. PARQUET-1376 Data obfuscation layer for encryption

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. PARQUET-1457 [C++] Data set integrity tool

          • Major - Major loss of function.
          • Open

          New Feature - A new feature of the product, which has yet to be developed. PARQUET-1373 Encryption key management tools

          • Major - Major loss of function.
          • Resolved

          New Feature - A new feature of the product, which has yet to be developed. PARQUET-1568 High level interface to Parquet encryption

          • Major - Major loss of function.
          • Resolved

          Test - A new unit, integration or system test. PARQUET-1397 Sample of usage Parquet-1396 and Parquet-1178 for column level encryption with pluggable key access

          • Major - Major loss of function.
          • Open
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-25119 Upgrade Parquet to 1.12.0

          • Major - Major loss of function.
          • Open
          links to

          Web Link Parquet modular encryption design doc

          Web Link Performance estimation

          Activity

            People

              gershinsky Gidon Gershinsky
              gershinsky Gidon Gershinsky
              Votes:
              14 Vote for this issue
              Watchers:
              32 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3h 50m
                  3h 50m