Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31257

Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 3.1.0
    • Fix Version/s: 3.1.0
    • Component/s: SQL
    • Labels:
      None
    • Target Version/s:

      Description

      There's a discussion in dev@ mailing list to point out ambiguous syntaxes for CREATE TABLE DDL. This issue tracks the efforts to resolve the root issue via unifying the create table syntax.

      https://lists.apache.org/thread.html/rf1acfaaa3de2d3129575199c28e7d529d38f2783e7d3c5be2ac8923d%40%3Cdev.spark.apache.org%3E

      We should ensure the new "single" create table syntax is very deterministic to both devs and end users.

      This work also includes how to pass the extra CREATE TABLE information(from the Hive tyle CREATE TABLE) to the v2 catalog:

      1.  turn the Hive serde info to table properties with `option.` prefix.

      2. add a new v2 table option `external` to indicate CREATE EXTERNAL TABLE.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                rdblue Ryan Blue
                Reporter:
                kabhwan Jungtaek Lim
              • Votes:
                0 Vote for this issue
                Watchers:
                11 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: