Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8699 Enable support for common map join [Spark Branch]
  3. HIVE-8793

Refactor to make splitting SparkWork a physical resolver [Spark Branch]

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • spark-branch
    • 1.1.0
    • Spark
    • None

    Description

      Currently, HIVE-8622 is implemented based on an assumption, that for a map join query, a BaseWork would not have multiple children. By testing through subquery_multiinsert.q did reveal that's the case. But, we need to investigate on this, and make sure this won't happen in general.

      Attachments

        1. HIVE-8793.1-spark.patch
          1.01 MB
          Rui Li
        2. HIVE-8793.2-spark.patch
          175 kB
          Rui Li

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HIVE-8840 Print prettier Spark work graph after HIVE-8793 [Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Sub-task - The sub-task of the issue HIVE-8841 Make RDD caching work for multi-insert after HIVE-8793 when map join is involved [Spark Branch]

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HIVE-8622 Split map-join plan into 2 SparkTasks in 3 stages [Spark Branch]

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link RB entry

          Activity

            People

              lirui Rui Li
              csun Chao Sun
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: