[SPARK-22759] Filters can be combined iff both are deterministic

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.0
• Component/s: Optimizer, SQL
• Assignee: Xiao Li
• Reporter: Xiao Li
• Created: 12/Dec/17 00:51
• Updated: 17/May/20 17:58
• Resolved: 27/Jul/19 18:05

Description

The query execution/optimization does not guarantee the expressions are evaluated in order. We only can combine them if and only if both are deterministic. We need to update the optimizer rule: CombineFilters.

Issue Links

• links to: [Github] Pull Request #19947 (gatorsmile)