[SPARK-37714] ANSI mode: allow casting between numeric type and timestamp type

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: SQL
• Assignee: Gengliang Wang
• Reporter: Gengliang Wang
• Created: 22/Dec/21 13:02
• Updated: 23/Dec/21 12:13
• Resolved: 23/Dec/21 12:13

Description

What changes were proposed?

• By default, allow casting between numeric type and timestamp type under ANSI mode
• Remove the user-facing configuration spark.sql.ansi.allowCastBetweenDatetimeAndNumeric

Why are the changes needed?

Same reason as mentioned in #34459. It is for better adoption of ANSI SQL mode since users are relying on it:

• As we did some data science, we found that many Spark SQL users are actually using Cast(Timestamp as Numeric) and Cast(Numeric as Timestamp).
• The Spark SQL connector for Tableau is using this feature for DateTime math. e.g.
  CAST(FROM_UNIXTIME(CAST(CAST(%1 AS BIGINT) + (%2 * 86400) AS BIGINT)) AS TIMESTAMP)

Issue Links

• links to: [Github] Pull Request #34985 (gengliangwang)