[SPARK-27881] Support CAST (... FORMAT <pattern>) expression

• Type: Improvement
• Status: In Progress
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.1.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Peter Toth
• Created: 30/May/19 13:24
• Updated: 16/Mar/20 22:52

Description

SQL:2016 standard supports the following Cast functions

CAST(<datetime> AS <char string type> [FORMAT <template>])
CAST(<char string> AS <datetime type> [FORMAT <template>])

to specify patterns to use during cast.

Oracle DB 18 already supports a similar formatting option during cast: https://docs.oracle.com/en/database/oracle/oracle-database/18/sqlrf/CAST.html

There is an initiative in Impala: IMPALA-4018 and Hive HIVE-21575 to support.
(Please note that accepting the CAST (... FORMAT <pattern>) is just one part of these tickets, the other part regarding patterns is covered here: SPARK-27882.)

Issue Links

• relates to: IMPALA-4018 Add support for SQL:2016 datetime templates/patterns/masks to CAST(... AS ... FORMAT <template>)
• relates to: HIVE-21575 Add support for SQL:2016 datetime templates/patterns/masks and CAST(... AS ... FORMAT <pattern>)
• links to: GitHub Pull Request #24742