[SPARK-26243] Use java.time API for parsing timestamps and dates from JSON

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 01/Dec/18 18:25
• Updated: 17/Jan/19 20:34
• Resolved: 16/Dec/18 01:33

Description

Currently, CSV datasource uses Apache FastDateFormat with a few fallbacks for parsing values of TimestampType and DateType. The result of parsing is an instance of java.util.Date/Timestamp which represents a specific instant in time, with millisecond precision. The tickets aims to switch on Java 8 API - java.time which allow parsing with nanoseconds precision.

Issue Links

• links to: [Github] Pull Request #23196 (MaxGekk)
• links to: [Github] Pull Request #23196 (MaxGekk)
• links to: [Github] Pull Request #23374 (MaxGekk)
• links to: [Github] Pull Request #23374 (MaxGekk)
• links to: GitHub Pull Request #23196
• links to: GitHub Pull Request #23329