Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31257

Unify create table syntax to fix ambiguous two different CREATE TABLE syntaxes

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.1.0
    • SQL
    • None

    Description

      There's a discussion in dev@ mailing list to point out ambiguous syntaxes for CREATE TABLE DDL. This issue tracks the efforts to resolve the root issue via unifying the create table syntax.

      https://lists.apache.org/thread.html/rf1acfaaa3de2d3129575199c28e7d529d38f2783e7d3c5be2ac8923d%40%3Cdev.spark.apache.org%3E

      We should ensure the new "single" create table syntax is very deterministic to both devs and end users.

      This work also includes how to pass the extra CREATE TABLE information(from the Hive tyle CREATE TABLE) to the v2 catalog:

      1.  turn the Hive serde info to table properties with `option.` prefix.

      2. add a new v2 table option `external` to indicate CREATE EXTERNAL TABLE.

      Attachments

        Issue Links

          Activity

            People

              rdblue Ryan Blue
              kabhwan Jungtaek Lim
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: