[SPARK-36130] UnwrapCastInBinaryComparison fail when in.list contain CheckOverflow expression

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: SQL
• Assignee: Fu Chen
• Reporter: Fu Chen
• Created: 14/Jul/21 03:17
• Updated: 12/Dec/22 18:11
• Resolved: 14/Jul/21 07:58

Description

UnwrapCastInBinaryComparison fail with the following case
 

CREATE TABLE tbl (d decimal(33, 27)) USING PARQUET 
SELECT d FROM tbl WHERE d NOT IN (d + 1)

 
Here in.list can be a CheckOverflow expression:

 cast(d#240 as decimal(34,27)) IN (CheckOverflow((promote_precision(cast(d#240 as decimal(34,27))) + 1.000000000000000000000000000), DecimalType(34,27), true))

{{}}

Issue Links

• is caused by: SPARK-35316 UnwrapCastInBinaryComparison support In/InSet predicate
• links to: [Github] Pull Request #33335 (cfmcgrady)
• links to: [Github] Pull Request #33335 (cfmcgrady)