[SPARK-29702] Resolve group-by columns with integrity constraints

• Type: Sub-task
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.0.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Takeshi Yamamuro
• Created: 01/Nov/19 04:42
• Updated: 27/Dec/19 01:56

Description

In PgSQL, integrity constraints affect grouping column resolution in an analyzer;

postgres=# \d gstest3
              Table "public.gstest3"
 Column |  Type   | Collation | Nullable | Default 
--------+---------+-----------+----------+---------
 a      | integer |           |          | 
 b      | integer |           |          | 
 c      | integer |           |          | 
 d      | integer |           |          | 

postgres=# select a, d, grouping(a,b,c) from gstest3 group by grouping sets ((a,b), (a,c));
ERROR:  column "gstest3.d" must appear in the GROUP BY clause or be used in an aggregate function
LINE 1: select a, d, grouping(a,b,c) from gstest3 group by grouping ...
                  ^
postgres=# alter table gstest3 add primary key (a);
ALTER TABLE

postgres=# select a, d, grouping(a,b,c) from gstest3 group by grouping sets ((a,b), (a,c));
 a | d | grouping 
---+---+----------
 1 | 1 |        1
 2 | 2 |        1
 1 | 1 |        2
 2 | 2 |        2
(4 rows)
 

Issue Links

• relates to: SPARK-19842 Informational Referential Integrity Constraints Support in Spark