Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7292 Hive on Spark
  3. HIVE-7541

Support union all on Spark [Spark Branch]

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • spark-branch
    • 1.1.0
    • Spark
    • None

    Description

      For union all operator, we will use Spark's union transformation. Refer to the design doc on wiki for more information.

      Attachments

        1. HIVE-7541.5-spark.patch
          27 kB
          Na Yang
        2. HIVE-7541.4-spark.patch
          26 kB
          Na Yang
        3. HIVE-7541.3-spark.patch
          20 kB
          Na Yang
        4. HIVE-7541.2-spark.patch
          20 kB
          Na Yang
        5. Hive on Spark Union All design.pdf
          84 kB
          Na Yang
        6. HIVE-7541.1-spark.patch
          16 kB
          Na Yang

        Issue Links

          contains

          Bug - A problem which impairs or prevents the functions of the product. HIVE-7651 Investigate why union two RDDs generated from two MapTrans does not get the right result

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. HIVE-7584 Change SparkCompiler to generate a SparkWork that contains UnionWork from logical operator tree

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. HIVE-7585 Implement the graph transformation execution

          • Major - Major loss of function.
          • Resolved

          Task - A task that needs to be done. HIVE-7586 Generate plan for spark work which uses spark union transformation

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue HIVE-7717 Add .q tests coverage for "union all" [Spark Branch]

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HIVE-7767 hive.optimize.union.remove does not work properly [Spark Branch]

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              nyang Na Yang
              xuefuz Xuefu Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: