[SPARK-7824] Collapsing operator reordering and constant folding into a single batch to push down the single side.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.1
• Fix Version/s: 1.5.0
• Component/s: SQL
• Target Version/s: 1.3.1
• Assignee: Zhongshuai Pei
• Reporter: Zhongshuai Pei
• Created: 22/May/15 08:41
• Updated: 12/Jun/15 00:02
• Resolved: 12/Jun/15 00:01

Description

SQL:

select * from tableA join tableB on (a > 3 and b = d) or (a > 3 and b = e)

Plan before modify

== Optimized Logical Plan ==
Project [a#293,b#294,c#295,d#296,e#297]
 Join Inner, Some(((a#293 > 3) && ((b#294 = d#296) || (b#294 = e#297))))
  MetastoreRelation default, tablea, None
  MetastoreRelation default, tableb, None

Plan after modify

== Optimized Logical Plan ==
Project [a#293,b#294,c#295,d#296,e#297]
 Join Inner, Some(((b#294 = d#296) || (b#294 = e#297)))
  Filter (a#293 > 3)
   MetastoreRelation default, tablea, None
  MetastoreRelation default, tableb, None

Issue Links

• links to: [Github] Pull Request #6351 (DoingDone9)