[ARROW-14467] [C++][Python][Parquet] Uniform encryption

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: C++, Parquet, Python
• External issue URL: https://github.com/apache/arrow/issues/18909
• Assignee: Unassigned
• Reporter: Maya Anderson
• Created: 26/Oct/21 10:08
• Updated: 11/Jan/23 08:40

Description

PME supports using the same encryption key for all columns, which is useful in a number of scenarios. However, misuse of this feature can break the NIST limit on the number of AES GCM operations with one key, as reported in PARQUET-2040. We will develop a limit-enforcing code and provide a Python API for uniform encryption, similarly to PARQUET-2040 and based on ARROW-9947.

Issue Links

• Dependency: ARROW-9947 [Python][Parquet] High-level Python API for Parquet encryption