[SPARK-35531] Can not insert into hive bucket table if create table with upper case schema - ASF JIRA

Attach files

Attach Screenshot

Voters

Watch issue

Watchers

Create sub-task

Link

Clone

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 3.0.0, 3.1.1, 3.2.0
Fix Version/s: 3.3.0, 3.1.4
Component/s: SQL
Labels:
None

Description

create table TEST1(
V1 BIGINT,
S1 INT)
partitioned by (PK BIGINT)
clustered by (V1)
sorted by (S1)
into 200 buckets
STORED AS PARQUET;

insert into test1
select
* from values(1,1,1);

org.apache.hadoop.hive.ql.metadata.HiveException: Bucket columns V1 is not part of the table columns ([FieldSchema(name:v1, type:bigint, comment:null), FieldSchema(name:s1, type:int, comment:null)]
org.apache.spark.sql.AnalysisException: org.apache.hadoop.hive.ql.metadata.HiveException: Bucket columns V1 is not part of the table columns ([FieldSchema(name:v1, type:bigint, comment:null), FieldSchema(name:s1, type:int, comment:null)]