[HIVE-12764] Support Intersect (distinct/all) Except (distinct/all) Minus (distinct/all) in Hive

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.1.0
• Fix Version/s: 2.3.0
• Labels: TODOC2.2
• Assignee: Pengcheng Xiong Assign to me
• Reporter: Pengcheng Xiong
• Created: 30/Dec/15 22:07
• Updated: 21/Jul/17 17:45
• Resolved: 11/Jan/17 02:32

Description

We plan to address union distinct (already done), intersect (all, distinct) and except (all, distinct) by leveraging the power of relational algebra through query rewriting.

Issue Links

• contains: HIVE-9039 Support Union Distinct
• is duplicated by: HIVE-13579 F304: EXCEPT ALL
• is duplicated by: HIVE-13580 E071-03: EXCEPT DISTINCT
• is duplicated by: HIVE-13581 F302-01 and F302-02: INTERSECT DISTINCT and INTERSECT ALL
• relates to: CALCITE-1446 Support INTERSECT, EXCEPT, MINUS, each with DISTINCT, ALL options

Sub-Tasks

• Support Intersect (distinct/all) Except (distinct/all) Minus (distinct/all): Closed
• Add a new UDTF Replicate_Rows: Closed
• Support UDTF in CBO (AST return path): Closed
• Support precedence for set operator using parentheses: Closed
• Remove the configuration HIVE_SUPPORT_SQL11_RESERVED_KEYWORDS: Resolved
• Upgrade ANTLR to 3.5.2: Resolved
• explainanalyze_2.q fails after HIVE-14861: Resolved
• HiveSortLimitPullUpConstantsRule misses branches when parent operator is Union: Closed
• SimpleFetchOptimizer needs to optimize limit=0: Resolved
• Support intersect/except without distinct keyword: Closed
• Support setOp in subQuery with parentheses: Closed
• Add more setOp tests to HivePerfCliDriver: Resolved
• Support Intersect (distinct/all) Except (distinct/all) Minus (distinct/all) in views: Open
• Add TPCDS query14.q to HivePerfCliDriver: Resolved