[PARQUET-2402] Create specialized HadoopParquetWriter

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: parquet-hadoop, parquet-mr
• Assignee: Unassigned
• Reporter: Atour Mousavi Gourabi
• Created: 03/Dec/23 15:26
• Updated: 23/Jun/24 03:33

Description

Setting up a specialized HadoopParquetWriter allows for deprecating the Hadoop specific methods in ParquetWriter as in PARQUET-2381. This could allow for an easier and more gentle transition away from the current Hadoop-coupled Parquet writer API by encouraging transitioning to this specialized class already, before completely phasing out the Hadoop methods from ParquetWriter in the future.

Issue Links

• blocks: PARQUET-2381 Deprecate methods relying on Hadoop classes when alternatives using more generic Parquet interfaces are available