[SPARK-35161] Error-handling SQL functions for ANSI SQL mode migration

• Type: Umbrella
• Status: Resolved
• Priority: Major
• Resolution: Done
• Affects Version/s: 3.2.0
• Component/s: SQL
• Epic Link: ANSI SQL compliance
• Assignee: Gengliang Wang
• Reporter: Gengliang Wang
• Shepherd: Gengliang Wang
• Created: 21/Apr/21 04:47
• Updated: 11/Dec/23 08:42
• Resolved: 26/Nov/23 07:09

Description

Create new Error-handling version SQL functions for existing SQL functions/operators, which returns NULL if overflow/error occurs. So that:
1. Users can manage to finish queries without interruptions in ANSI mode.
2. Users can get NULLs instead of unreasonable results if overflow occurs when ANSI mode is off.
For example, the behavior of the following SQL operations is unreasonable:

2147483647 + 2 => -2147483647
CAST(2147483648L AS INT) => -2147483648

With the new safe version SQL functions:

TRY_ADD(2147483647, 2) => null
TRY_CAST(2147483648L AS INT) => null

Sub-Tasks

• Remove unnecessary TryEval in TryCast: In Progress
• try_to_timestamp should handle SparkUpgradeException: Open