[SPARK-38829] New configuration for controlling timestamp inference of Parquet

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: SQL
• Assignee: Ivan Sadikov
• Reporter: Gengliang Wang
• Created: 08/Apr/22 08:24
• Updated: 01/Feb/23 22:02
• Resolved: 13/Apr/22 09:06

Description

A new SQL conf which can fallback to the behavior that reads all the Parquet Timestamp column as TimestampType.

Issue Links

• links to: [Github] Pull Request #36137 (sadikovi)
• links to: [Github] Pull Request #36137 (sadikovi)
• links to: [Github] Pull Request #36158 (sadikovi)
• links to: [Github] Pull Request #36158 (sadikovi)
• links to: [Github] Pull Request #36573 (LuciferYang)
• links to: [Github] Pull Request #39856 (gengliangwang)