Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-3860 Improve dimension joins
  3. SPARK-3862

MultiWayBroadcastInnerHashJoin

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • SQL
    • None

    Description

      It is common to have a single fact table inner join many small dimension tables. We can exploit this fact and create a MultiWayBroadcastInnerHashJoin (or maybe just MultiwayDimensionJoin) operator that optimizes for this pattern.

      Attachments

        Issue Links

          is duplicated by

          Sub-task - The sub-task of the issue SPARK-2215 Multi-way join

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          links to

          Pull request #2985 [Github] Pull Request #2985 (rxin)

          Pull request #5326 [Github] Pull Request #5326 (chenghao-intel)

          Activity

            People

              Unassigned Unassigned
              rxin Reynold Xin
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: