Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-27764

Feature Parity between PostgreSQL and Spark

    Details

    • Type: Umbrella
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 3.0.0
    • Fix Version/s: None
    • Component/s: SQL
    • Labels:
      None

      Description

      PostgreSQL is one of the most advanced open source databases. This umbrella Jira is trying to track the missing features and bugs. 

       

        Attachments

          Issue Links

          1.
          Infinity, -Infinity, NaN should be recognized in a case insensitive manner Sub-task Open Unassigned
          2.
          Handling of sublinks within outer-level aggregates. Sub-task Open Unassigned
          3.
          ANSI SQL: LATERAL derived table(T491) Sub-task Open Unassigned
          4.
          Support ARRAY(sub-SELECT) expressions Sub-task In Progress Unassigned
          5.
          Implement bitwise integer aggregates(BIT_AND and BIT_OR) Sub-task Open Unassigned
          6.
          Implement boolean aggregates(BOOL_AND, BOOL_OR and EVERY) Sub-task Open Unassigned
          7.
          support statement using nested joins Sub-task Reopened Unassigned
          8.
          List all cases that PostgreSQL throws an exception but Spark SQL is NULL Sub-task Open Unassigned
          9.
          List all built-in UDFs have different names Sub-task Open Unassigned
          10.
          ANSI SQL: Boolean Test Sub-task In Progress Unassigned
          11.
          Accept 'on' and 'off' as input for boolean data type Sub-task Open Unassigned
          12.
          ANSI SQL: NTH_VALUE function Sub-task Open Unassigned
          13.
          String Functions: regexp_replace is not compatible Sub-task Open Unassigned
          14.
          Add built-in Aggregate Function: array_agg Sub-task Open Unassigned
          15.
          Add built-in Array Functions: array_append Sub-task Open Unassigned
          16.
          Add built-in Aggregate Functions: string_agg Sub-task Open Unassigned
          17.
          Add built-in Ordered-Set Aggregate Functions: percentile_cont Sub-task Open Unassigned
          18.
          Support Aggregate Expressions Sub-task Open Unassigned
          19.
          Support POSIX Regular Expressions Sub-task Open Unassigned
          20.
          Caret operator (^) means bitwise XOR in Spark/Hive and exponentiation in Postgres/Redshift Sub-task Open Unassigned
          21.
          Support ORDER BY ... USING syntax Sub-task Open Unassigned
          22.
          Enhance EXTRACT/DATE_TRUNC Sub-task Open Unassigned
          23.
          Missing some mathematical operators Sub-task In Progress Unassigned
          24.
          Cast numeric to integral type need round Sub-task Open Unassigned
          25.
          Built-in udf left/right has inconsistent behavior Sub-task Open Unassigned
          26.
          Add built-in String Functions: quote_literal Sub-task Open Unassigned
          27.
          String concatenation should low priority than other operators Sub-task In Progress Unassigned
          28.
          Support for converting float/double to binary format Sub-task Open Unassigned
          29.
          Order by does not accept a call to rank() Sub-task Open Unassigned
          30.
          ntile does not accept NULL as input Sub-task Open Unassigned
          31.
          `lag` second argument must be a literal Sub-task Open Unassigned
          32.
          String Functions: SUBSTRING support regular expression Sub-task Open Unassigned
          33.
          String Functions: Add support other 4 REGEXP functions Sub-task Open Unassigned
          34.
          String Functions: Add support split_part Sub-task Open Unassigned
          35.
          Support ANSI SQL: LIKE ... ESCAPE syntax Sub-task In Progress Unassigned
          36.
          Adds `random()` sql function Sub-task Open Unassigned
          37.
          String Functions: decode can not accept 'escape' as charset Sub-task Open Unassigned
          38.
          Binary String Functions: SHA functions Sub-task Open Unassigned
          39.
          String Functions: Add support btrim Sub-task Open Unassigned
          40.
          Trigonometric Functions Sub-task Open Unassigned
          41.
          Data Type Formatting Functions Sub-task Open Unassigned
          42.
          Timestamp/Date type can not accept special values Sub-task Open Unassigned
          43.
          Date/Timestamp type have different low value and high value with Spark Sub-task Open Unassigned
          44.
          Support IS OF (<type>) predicate Sub-task Open Unassigned
          45.
          Support RETURNING cause Sub-task Open Unassigned
          46.
          Difference of interval type conversion between SparkSQL and PostgreSQL Sub-task Open Unassigned
          47.
          Date/Time Output Styles and Date Order Conventions Sub-task Open Unassigned
          48.
          ANSI SQL: Recursive query Sub-task In Progress Unassigned
          49.
          Improved VALUES support Sub-task Open Unassigned
          50.
          Handling outer links in CTE subquery expressions Sub-task Open Unassigned
          51.
          Strange behavior of CAST string to char/varchar Sub-task Open Unassigned
          52.
          Evaluation of multiple CTE uses Sub-task Open Unassigned
          53.
          Support Interval comparison Sub-task Open Unassigned
          54.
          Decimal can not accept NaN as input Sub-task Open Unassigned
          55.
          Decimal precision issue Sub-task Open Unassigned
          56.
          Built-in Mathematical Functions: SCALE Sub-task Open Unassigned
          57.
          Decimal can only support precision up to 38 Sub-task Open Unassigned
          58.
          DIV support decimal type Sub-task In Progress Unassigned
          59.
          The LOG function using 10 as the base, but Spark using E Sub-task Open Unassigned
          60.
          Support ANSI SQL:SIMILAR TO ... ESCAPE syntax Sub-task Open Unassigned
          61.
          Support ANSI SQL:member predicate Sub-task Open Unassigned
          62.
          SELECT INTO syntax Sub-task Open Unassigned
          63.
          Enhance query limit Sub-task Open Unassigned
          64.
          NULLS FIRST for DESC and NULLS LAST for ASC Sub-task In Progress Unassigned
          65.
          Fully support correlation names in the FROM clause Sub-task Open Unassigned
          66.
          Implement range partition in Spark Sub-task Open Unassigned
          67.
          Correlated scalar subqueries must be aggregated Sub-task Open Unassigned
          68.
          Array Functions: unnest Sub-task Open Unassigned
          69.
          SELECT DISTINCT ON ( expression [, ...] ) syntax Sub-task Open Unassigned
          70.
          Add built-in Array Functions: array_upper Sub-task Open Unassigned
          71.
          Add built-in Array Functions: element to array concatenation Sub-task Open Unassigned
          72.
          Array indexing is 1-based Sub-task Open Unassigned
          73.
          Join with USING caluse doesn't hide original tables Sub-task Open Unassigned
          74.
          SELECT FROM syntax Sub-task Open Unassigned
          75.
          ANSI SQL: OVERLAY function support byte array(T312) Sub-task Open Unassigned
          76.
          Date/Time Functions: date_part Sub-task Open Unassigned
          77.
          Improve interval input Sub-task Open Unassigned
          78.
          Add more Date/Time Operators Sub-task Open Unassigned
          79.
          Support more Postgres JSON functions Sub-task Open Unassigned
          80.
          Spark `exclude` always expecting `()` Sub-task Open Unassigned
          81.
          SQL Datetime util function being casted to double instead of timestamp Sub-task Open Unassigned
          82.
          Date/Time Functions: make_date/make_timestamp Sub-task Open Unassigned
          83.
          Support cast StringType to IntervalType for SQL interface Sub-task Open Unassigned
          84.
          Different format when casting interval type to string type Sub-task Open Unassigned
          85.
          ANSI SQL: Unicode escapes in literals Sub-task Open Unassigned
          86.
          Implement ILIKE operator Sub-task Open Unassigned
          87.
          Missing escape_string_warning and standard_conforming_strings config Sub-task Open Unassigned
          88.
          substr returns different values Sub-task Open Unassigned
          89.
          Support recursive view syntax Sub-task Open Unassigned

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                smilegator Xiao Li
              • Votes:
                1 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated: