[SPARK-13354] Push filter throughout outer join when the condition can filter out empty row

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: SQL
• Assignee: Davies Liu
• Reporter: Davies Liu
• Created: 17/Feb/16 01:02
• Updated: 18/Feb/16 07:38
• Resolved: 18/Feb/16 07:38

Description

For a query

select * from a left outer join b on a.a = b.a where b.b > 10

The condition `b.b > 10` will filter out all the row that the b part of it is empty.

In this case, we should use Inner join, and push down the filter into b.

Issue Links

• is duplicated by: SPARK-12594 Outer Join Elimination by Filter Condition
• links to: [Github] Pull Request #11234 (davies)