[SPARK-26903] Remove the TimeZone cache

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 3.0.0
• Component/s: SQL
• Docs Text: Prior to Spark 3, if an invalid timezone was specified to to_utc_timestamp and from_utc_timestamp, it would silently be interpreted as GMT. It now results in an exception.
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 16/Feb/19 22:36
• Updated: 08/Jun/20 17:18
• Resolved: 23/Feb/19 15:44

Description

The ZoneOffset class in JDK 8 caches zone offsets internally: http://hg.openjdk.java.net/jdk8/jdk8/jdk/file/687fd7c7986d/src/share/classes/java/time/ZoneOffset.java#l205 . No need to cache time zones in Spark. The ticket aims to remove computedTimeZones from DateTimeUtils.

Issue Links

• is related to: SPARK-24778 DateTimeUtils.getTimeZone method returns GMT time if timezone cannot be parsed
• links to: GitHub Pull Request #23812