[SPARK-27438] Increase precision of to_timestamp

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 11/Apr/19 05:58
• Updated: 02/Feb/20 19:37
• Resolved: 22/Apr/19 12:06

Description

The to_timestamp() function can parse input string up to second precision even if the specified pattern contains second fraction sub-pattern. The ticket aims to improve precision of to_timestamp() up to microsecond precision.

Issue Links

• is related to: SPARK-30668 to_timestamp failed to parse 2020-01-27T20:06:11.847-0800 using pattern "yyyy-MM-dd'T'HH:mm:ss.SSSz"
• links to: GitHub Pull Request #24342
• links to: GitHub Pull Request #24420