[SPARK-33588] Partition spec in SHOW TABLE EXTENDED doesn't respect `spark.sql.caseSensitive`

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.7, 3.0.1, 3.1.0
• Fix Version/s: 2.4.8, 3.0.2, 3.1.0
• Component/s: SQL
• Assignee: Max Gekk
• Reporter: Max Gekk
• Created: 28/Nov/20 20:27
• Updated: 30/Nov/20 16:40
• Resolved: 29/Nov/20 20:12

Description

For example:

spark-sql> CREATE TABLE tbl1 (price int, qty int, year int, month int)
         > USING parquet
         > partitioned by (year, month);
spark-sql> INSERT INTO tbl1 PARTITION(year = 2015, month = 1) SELECT 1, 1;
spark-sql> SHOW TABLE EXTENDED LIKE 'tbl1' PARTITION(YEAR = 2015, Month = 1);
Error in query: Partition spec is invalid. The spec (YEAR, Month) must match the partition spec (year, month) defined in table '`default`.`tbl1`';

The spark.sql.caseSensitive flag is false by default, so, the partition spec is valid.

Issue Links

• links to: [Github] Pull Request #30529 (MaxGekk)
• links to: [Github] Pull Request #30549 (MaxGekk)
• links to: [Github] Pull Request #30549 (MaxGekk)
• links to: [Github] Pull Request #30551 (MaxGekk)