[SPARK-48288] Add source data type to connector.Cast expression

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Spark Core
• Labels: pull-request-available
• Assignee: Uros Stankovic
• Reporter: Uros Stankovic
• Created: 15/May/24 10:19
• Updated: 16/May/24 11:52
• Resolved: 16/May/24 11:52

Description

Currently, 
V2ExpressionBuilder will build connector.Cast expression from catalyst.Cast expression.
Catalyst cast have expression data type, but connector cast does not have it.
Since some casts are not allowed on external engine, we need to know source and target data type, since we want finer granularity to block some unsupported casts.

Issue Links

• links to: GitHub Pull Request #46596