[SPARK-30447] Constant propagation nullability issue

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0, 2.3.1, 2.3.2, 2.3.3, 2.3.4, 2.4.4, 3.0.0
• Fix Version/s: 2.4.5, 3.0.0
• Component/s: SQL
• Labels: correctness
• Assignee: Peter Toth
• Reporter: Peter Toth
• Created: 07/Jan/20 15:46
• Updated: 02/Mar/20 22:16
• Resolved: 10/Jan/20 12:45

Description

There is a bug in constant propagation due to null handling:

SELECT * FROM t WHERE NOT(c = 1 AND c + 1 = 1) returns those rows where c is null due to 1 + 1 = 1 propagation, but it shouldn't.

Issue Links

• links to: GitHub Pull Request #27119
• links to: GitHub Pull Request #27167