[SPARK-34705] Add code-gen for all join types of sort merge join

• Type: Umbrella
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 3.2.0
• Fix Version/s: 3.3.0
• Component/s: SQL
• Assignee: Cheng Su
• Reporter: Cheng Su
• Created: 11/Mar/21 02:24
• Updated: 17/Feb/23 05:36
• Resolved: 17/Feb/23 05:34

Description

Currently sort merge join only supports inner join type (https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala#L374 ). We added code-gen for other join types internally in our fork and saw obvious CPU performance improvement. Create this Jira to propose to merge back to upstream.

Sub-Tasks

• Refactor sort merge join code-gen be agnostic to join type: Resolved
• Add code-gen for left/right outer sort merge join: Resolved
• Add code-gen for left semi sort merge join: Resolved
• Add code-gen for left anti sort merge join: Resolved
• Add code-gen for full outer sort merge join: Resolved
• Add code-gen for existence sort merge join: Resolved