[SPARK-38437] Dynamic serialization of Java datetime objects to micros/days

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 07/Mar/22 19:36
• Updated: 09/Mar/22 08:37
• Resolved: 09/Mar/22 08:37

Description

Make serializers to micros/days more tolerant to input Java objects, and accept:

• for timestamps: java.sql.Timestamp and java.time.Instant
• for days: java.sql.Date and java.time.LocalDate

This should make Spark SQL more reliable to user's and datasource inputs.

Issue Links

• relates to: SPARK-38315 Add a config to control decoding of datetime as Java 8 classes
• links to: [Github] Pull Request #35756 (MaxGekk)