[SPARK-36670] Add end-to-end codec test cases for main datasources

• Type: Test
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: SQL
• Assignee: L. C. Hsieh
• Reporter: L. C. Hsieh
• Created: 04/Sep/21 21:49
• Updated: 21/Sep/21 15:11
• Resolved: 07/Sep/21 23:53

Description

We found there is no e2e test cases available for main datasources like Parquet, Orc. It makes developers harder to identify possible bugs early. We should add such tests in Spark.

Issue Links

• is related to: SPARK-36731 BrotliCodec doesn't support Apple Silicon on MacOS
• links to: [Github] Pull Request #33912 (viirya)
• links to: [Github] Pull Request #33939 (viirya)
• links to: [Github] Pull Request #34059 (gengliangwang)