[SPARK-30374] Feature Parity between PostgreSQL and Spark (ANSI/SQL) - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Umbrella
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: 3.0.0
Fix Version/s: None
Component/s: SQL
Labels:
None

Epic Link:
ANSI SQL compliance

Description

Among the feature parity between Spark/PostgreSQL (SPARK-27764), this umbrella holds issues for the ANSI/SQL standard.

Attachments

Issue Links

is related to

SPARK-27764 Feature Parity between PostgreSQL and Spark

Open

relates to

SPARK-33459 Commonly used Teradata extension syntax

Open

links to

GitHub Pull Request #27152

Sub-Tasks

1.	Support ANSI SQL Boolean-Predicate syntax	Resolved	jiaan.geng
2.	ANSI SQL: NTH_VALUE function	Resolved	jiaan.geng
3.	ANSI SQL: LATERAL derived table(T491)	Closed	Unassigned
4.	ANSI SQL: Character literals	Resolved	Unassigned
5.	ANSI SQL: OVERLAY function(T312)	Resolved	jiaan.geng
6.	Support ANSI SQL: LIKE ... ESCAPE syntax	Resolved	jiaan.geng
7.	ANSI-F053: Overlaps datetimes predicate support	Open	Unassigned
8.	Support ANSI SQL CREATE SEQUENCE	Open	Unassigned
9.	Forbid reserved keywords as identifiers when ANSI mode is on	Resolved	Takeshi Yamamuro
10.	ANSI SQL: Recursive query	In Progress	Unassigned
11.	Support LOCALTIMESTAMP when ANSI mode enabled	Resolved	Unassigned
12.	Support CURRENT_TIME and LOCALTIME when ANSI mode enabled	Resolved	Unassigned
13.	Test both ANSI mode and Spark mode	Open	Unassigned
14.	ANSI SQL: Nested bracketed comments	Resolved	jiaan.geng
15.	ANSI SQL: delete and update does not support in Spark	Resolved	Unassigned
16.	ANSI SQL: Collation Support	Open	Unassigned
17.	ANSI SQL: unique predicate	Open	Unassigned
18.	ANSI SQL: OVERLAY function support byte array(T312)	Resolved	jiaan.geng
19.	ANSI SQL(E021-05): OCTET_LENGTH function	Resolved	Unassigned
20.	Support ANSI SQL:SIMILAR TO ... ESCAPE syntax	In Progress	Unassigned
21.	ANSI SQL: Unicode escapes in literals	Open	Unassigned
22.	Support ANSI SQL:member predicate	Open	Unassigned
23.	ANSI SQL: Top-level <result offset clause> in <query expression>	Resolved	jiaan.geng
24.	Support Aggregate Expressions with filter	Resolved	jiaan.geng
25.	define reserved keywords after SQL standard	Resolved	Takeshi Yamamuro
26.	Support Filter expression allows simultaneous use of DISTINCT	Resolved	jiaan.geng
27.	Support Filter expression uses IN/EXISTS predicate sub-queries	Resolved	Tanel Kiis
28.	Support Filter expression reference the outer query	Open	Unassigned
29.	Support dec as shorthand for decimal	Resolved	Kent Yao
30.	SELECT INTO syntax	Open	Unassigned
31.	adds support for `filter` clause	Resolved	Unassigned
32.	Support WITH clause in subqueries	Resolved	Peter Toth
33.	DIV support decimal type	Resolved	Marco Gaido
34.	Fully support correlation names in the FROM clause	Open	Unassigned
35.	Real data type is not supported in Spark SQL which is supporting in postgresql	Resolved	Kent Yao
36.	Throw exception on overflow for integers	Resolved	Marco Gaido
37.	The exact math method should be called only when there is a corresponding function in Math	Resolved	Gengliang Wang
38.	Support option to throw exception if overflow occurs during Decimal arithmetic	Resolved	Marco Gaido
39.	Spark should support select <columnname> into <table> from <table> where <condition> as PostgreSQL supports	Resolved	Unassigned
40.	When one or more DISTINCT aggregate expressions operate on the same field, the DISTINCT aggregate expression allows the use of the FILTER clause	Resolved	Unassigned
41.	When there are multiple DISTINCT aggregate expressions acting on different fields, any DISTINCT aggregate expression allows the use of the FILTER clause	Resolved	Unassigned
42.	[SQL] ANSI SQL: Throw exception on format invalid and overflow when casting String to IntegerType.	Resolved	Unassigned
43.	Lead/Lag window function throws AnalysisException without ORDER BY clause	In Progress	Unassigned
44.	first_value/last_value window function throws ParseException	Resolved	Unassigned
45.	ANSI SQL: FIRST_VALUE function	Closed	Unassigned
46.	ANSI SQL: LAST_VALUE function	Closed	Unassigned
47.	AnalysisException that window RangeFrame not match RowFrame	Resolved	Unassigned
48.	Spark SQL can't display bracketed comments well in generated golden files	Resolved	jiaan.geng
49.	Support (IGNORE \| RESPECT) NULLS for LEAD/LAG/NTH_VALUE/FIRST_VALUE/LAST_VALUE	Resolved	Apache Spark
50.	Add documents information for window function.	Resolved	jiaan.geng
51.	Support grant/revoke access privileges like postgresql	Open	Unassigned
52.	Eliminate filter clause in aggregate	Resolved	jiaan.geng
53.	Aggregation support aggregate function with multiple foldable expressions.	Resolved	jiaan.geng
54.	Improve the performance for NTH_VALUE and Reactor the OffsetWindowFunction	Resolved	jiaan.geng
55.	Respect ANSI standard and change FIRST_VALUE as pure window function.	Resolved	Unassigned
56.	Improve the performance for FIRST_VALUE	Resolved	jiaan.geng
57.	Support drop column in spark also like in postgresql	Open	Unassigned
58.	LEAD/LAG should support [ IGNORE NULLS \| RESPECT NULLS ]	Resolved	jiaan.geng
59.	ANALYZE command support analyze all tables in a specific database	Resolved	Yuming Wang
60.	Improve performance for nth_value ignore nulls over offset window	Resolved	jiaan.geng
61.	Improve performance for last_value over unbounded window frame	Resolved	Unassigned
62.	Improve performance for last_value over unbounded preceding window frame	Resolved	Unassigned
63.	ANSI SQL: LATERAL derived table(T491)	Resolved	Allison Wang
64.	Support the utils for escapse the regex for ANSI SQL: SIMILAR TO ... ESCAPE syntax	In Progress	Unassigned
65.	Check unclosed bracketed comments	Resolved	jiaan.geng

Activity

People

Assignee:: Unassigned

Reporter:: Takeshi Yamamuro

Votes:: 2 Vote for this issue

Watchers:: 5 Start watching this issue

Dates

Created:: 29/Dec/19 00:13

Updated:: 12/Apr/21 13:41