Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-7613

Research optimization of auto convert join to map join [Spark branch]

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: Spark
    • Labels:
      None

      Description

      ConvertJoinMapJoin is an optimization the replaces a common join(aka shuffle join) with a map join(aka broadcast or fragment replicate join) when possible. we need to research how to make it workable with Hive on Spark.

        Attachments

        1. small_table_broadcasting.pdf
          44 kB
          Xuefu Zhang
        2. HIve on Spark Map join background.docx
          123 kB
          Szehon Ho
        3. Hive on Spark Join Master Design.pdf
          1.32 MB
          Szehon Ho

          Issue Links

            Activity

              People

              • Assignee:
                ssatish Suhas Satish
                Reporter:
                chengxiang li Chengxiang Li
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: