[SPARK-45711] Introduce a mapper for avro compression codecs

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Jiaan Geng
• Reporter: Jiaan Geng
• Created: 27/Oct/23 12:43
• Updated: 29/Oct/23 01:19
• Resolved: 29/Oct/23 01:18

Description

Currently, Spark supported all the avro compression codecs, but the avro supported compression codecs and spark supported are not completely one-on-one due to Spark introduce the compression codecs UNCOMPRESSED.

There are a lot of magic strings copy from avro compression codecs. This issue lead to developers need to manually maintain its consistency. It is easy to make mistakes and reduce development efficiency.

Issue Links

• links to: GitHub Pull Request #43562