Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-34705

Add code-gen for all join types of sort merge join

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.2.0
    • 3.3.0
    • SQL
    • None

    Description

      Currently sort merge join only supports inner join type (https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala#L374 ). We added code-gen for other join types internally in our fork and saw obvious CPU performance improvement. Create this Jira to propose to merge back to upstream.

      Attachments

        There are no Sub-Tasks for this issue.

        Activity

          People

            chengsu Cheng Su
            chengsu Cheng Su
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: