Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-7613

Research optimization of auto convert join to map join [Spark branch]

Log workAgile BoardRank to TopRank to BottomVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: Spark
    • Labels:
      None

      Description

      ConvertJoinMapJoin is an optimization the replaces a common join(aka shuffle join) with a map join(aka broadcast or fragment replicate join) when possible. we need to research how to make it workable with Hive on Spark.

        Attachments

        1. HIve on Spark Map join background.docx
          123 kB
          Szehon Ho
        2. small_table_broadcasting.pdf
          44 kB
          Xuefu Zhang
        3. Hive on Spark Join Master Design.pdf
          1.32 MB
          Szehon Ho

        Issue Links

          Activity

          $i18n.getText('security.level.explanation', $currentSelection) Viewable by All Users
          Cancel

            People

            • Assignee:
              ssatish Suhas Satish Assign to me
              Reporter:
              chengxiang li Chengxiang Li

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment