[SPARK-49065] Rebasing in legacy formatters/parsers must support non JVM default time zones

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.5.0, 4.0.0, 3.5.1
• Fix Version/s: 4.0.0, 3.5.2
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Sumeet Varma
• Reporter: Sumeet Varma
• Created: 31/Jul/24 01:19
• Updated: 01/Aug/24 14:29
• Resolved: 01/Aug/24 14:29

Description

Currently, rebasing timestamp defaults to JVM timezone and so it produces incorrect results when the explicitly over-riden timezone in the TimestampFormatter library is not the same as JVM timezone.

To fix it, explicitly pass the overridden timezone parameter to rebaseJulianToGregorianMicros and rebaseGregorianToJulianMicros

 

Issue Links

• links to: GitHub Pull Request #47541