[SPARK-34533] Eliminate LEFT ANTI join to empty relation in AQE

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.2.0
• Component/s: SQL
• Assignee: Cheng Su
• Reporter: Cheng Su
• Created: 25/Feb/21 02:49
• Updated: 11/Mar/21 02:41
• Resolved: 26/Feb/21 11:46

Description

I discovered from review discussion - https://github.com/apache/spark/pull/31630#discussion_r581774000 , that we can eliminate LEFT ANTI join (with no join condition) to empty relation, if the right side is known to be non-empty. So with AQE, this is doable similar to https://github.com/apache/spark/pull/29484 .

Issue Links

• links to: [Github] Pull Request #31641 (c21)
• links to: [Github] Pull Request #31641 (c21)