[SPARK-24994] Add UnwrapCastInBinaryComparison optimizer to simplify literal types

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.1.0
• Fix Version/s: 3.1.0
• Component/s: SQL
• Assignee: Chao Sun
• Reporter: liuxian
• Created: 02/Aug/18 04:27
• Updated: 15/Jun/22 04:00
• Resolved: 13/Sep/20 04:36

Description

For this statement: select * from table1 where a = 100;
the data type of `a` is `smallint` , because the defaut data type of 100 is `int` ,so the data type of  'a' is converted to `int`.
In this case, it does not support push down to parquet.

In our business, for our SQL statements, and we generally do not convert 100 to `smallint`, We hope that it can support push down to parquet for this situation.

Issue Links

• duplicates: SPARK-32694 Pushdown cast to data sources
• relates to: SPARK-9182 filter and groupBy on DataFrames are not passed through to jdbc source
• relates to: SPARK-32858 UnwrapCastInBinaryComparison: support other numeric types
• relates to: SPARK-35316 UnwrapCastInBinaryComparison support In/InSet predicate
• relates to: SPARK-36607 Support BooleanType in UnwrapCastInBinaryComparison
• links to: [Github] Pull Request #21957 (10110346)
• links to: [Github] Pull Request #29565 (sunchao)
• links to: [Github] Pull Request #29775 (sunchao)
• links to: [Github] Pull Request #36873 (WangGuangxin)
• links to: GitHub Pull Request #21957
• links to: GitHub Pull Request #27648