Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-34705

Add code-gen for all join types of sort merge join

    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.2.0
    • None
    • SQL
    • None

    Description

      Currently sort merge join only supports inner join type (https://github.com/apache/spark/blob/master/sql/core/src/main/scala/org/apache/spark/sql/execution/joins/SortMergeJoinExec.scala#L374 ). We added code-gen for other join types internally in our fork and saw obvious CPU performance improvement. Create this Jira to propose to merge back to upstream.

      Attachments

        Activity

          People

            Unassigned Unassigned
            chengsu Cheng Su
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: