[PARQUET-1817] Crypto Properties Factory

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.12.0
• Component/s: parquet-mr
• Labels: pull-request-available
• Assignee: Xinli Shang
• Reporter: Gidon Gershinsky
• Created: 16/Mar/20 06:51
• Updated: 23/Jun/24 03:31
• Resolved: 30/Mar/20 08:58

Description

Basic common interface (abstract class) for loading of file encryption and decryption properties - making them transparent to analytic frameworks, so they can leverage Parquet modular encryption (PARQUET-1178) without any code changes . This interface depends on passing of Hadoop configuration - already done by frameworks that work with parquet-mr. The "write" part of the interface can also utilize the name/path of the file being written, and its WriteContext, that contains the schema with extensions.

Issue Links

• is depended upon by: PARQUET-1568 High level interface to Parquet encryption
• links to: Design doc
• links to: GitHub Pull Request #769