[SPARK-45793] Improve the built-in compression codecs

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Spark Core
• Labels: pull-request-available
• Assignee: Jiaan Geng
• Reporter: Jiaan Geng
• Created: 05/Nov/23 02:16
• Updated: 06/Nov/23 12:07
• Resolved: 06/Nov/23 12:07

Description

Currently, Spark supported many built-in compression codecs used for I/O and storage.
There are a lot of magic strings copy from built-in compression codecs. This issue lead to developers need to manually maintain its consistency. It is easy to make mistakes and reduce development efficiency.

Issue Links

• links to: GitHub Pull Request #43659