[SPARK-39039] Conditional expression evaluation ordering

• Type: Umbrella
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.4.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: XiDuo You
• Created: 27/Apr/22 08:19
• Updated: 27/Apr/22 08:19

Description

Make sure the conditional expression evaluation ordering is always same, in case the different expression ordering cause the different result.

It gets worse with ansi mode which could fail at runtime.

Sub-Tasks

• Respect NaNvl in EquivalentExpressions for expression elimination: Resolved
• Add ConditionalExpression trait: Resolved
• Correct conditional expression constant folding: Resolved
• Python UDF does not follow the conditional expression evaluation order: Open