[PARQUET-1804] Provide pluggable APIs to support user customized compression codec

• Type: Wish
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Component/s: parquet-mr
• Assignee: Unassigned
• Reporter: XinDong
• Created: 25/Feb/20 06:26
• Updated: 04/Dec/23 11:28

Description

In demand of better performance, quite some end users want to leverage accelerators (e.g. FPGA, Intel QAT) to offload compression computation. Parquet, as a well adopted data format, should allow compression codec implementation customization via a pluggable mechanism for those standard compression codec. This JIRA is intended for introducing this set of APIs.

Issue Links

• links to: Pull Request