[SPARK-36536] Split the JSON/CSV option of datetime format to in read and in write

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.3.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 17/Aug/21 18:46
• Updated: 23/Aug/21 09:00
• Resolved: 19/Aug/21 06:31

Description

This is a follow up of https://issues.apache.org/jira/browse/SPARK-36418. Need to split JSON and CSV options dateFormat and timestampFormat. In write, should be the same but in read the option shouldn't be set to a default value. In this way, DateFormatter and TimestampFormatter will use the CAST logic.

Issue Links

• links to: [Github] Pull Request #33769 (MaxGekk)
• links to: [Github] Pull Request #33809 (MaxGekk)
• links to: [Github] Pull Request #33809 (MaxGekk)