Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-33392 Align DSv2 commands to DSv1 implementation
  3. SPARK-33511

Respect case sensitivity in resolving partition specs V2

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.1.0
    • 3.1.0
    • SQL
    • None

    Description

      DSv1 DDL commands respect the SQL config spark.sql.caseSensitive, for example

      spark-sql> CREATE TABLE tbl1 (id bigint, data string) USING parquet PARTITIONED BY (id);
      spark-sql> ALTER TABLE tbl1 ADD PARTITION (ID=1);
      spark-sql> SHOW PARTITIONS tbl1;
      id=1
      

      but the same ALTER TABLE command fails on DSv2.

      Attachments

        Activity

          People

            maxgekk Max Gekk
            maxgekk Max Gekk
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: