[SPARK-30471] Fix issue when compare string and IntegerType

• Type: Bug
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: feiwang
• Created: 09/Jan/20 11:33
• Updated: 13/Dec/21 04:51

Description

When we comparing a String Type and IntegerType:
'2147483648'(StringType, which exceed Int.MaxValue) > 0(IntegerType).

Now the result of findCommonTypeForBinaryComparison(StringType, IntegerType) is IntegerType.

But the value of string may exceed Int.MaxValue, then the result is corruputed.

For example:

// Some comments here
CREATE TEMPORARY VIEW ta AS SELECT * FROM VALUES(CAST ('2147483648' AS STRING))  AS ta(id);
SELECT * FROM ta WHERE id > 0; // result is null

Issue Links

• duplicates: SPARK-21646 Add new type coercion rules to compatible with Hive
• is duplicated by: SPARK-31508 string type compare with numberic cause data inaccurate
• links to: [Github] Pull Request #34862 (Kwafoor)
• links to: GitHub Pull Request #27150