[SPARK-41104] Can insert NULL into hive table table with NOT NULL column

• Type: Bug
• Status: Open
• Priority: Critical
• Resolution: Unresolved
• Affects Version/s: 3.4.0
• Component/s: Spark Core
• Assignee: Unassigned
• Reporter: Serge Rielau
• Shepherd: Wenchen Fan
• Created: 10/Nov/22 22:13
• Updated: 10/Nov/22 22:18

Description

spark-sql> CREATE TABLE tttd(c1 int not null);
22/11/10 14:04:28 WARN ResolveSessionCatalog: A Hive serde table will be created as there is no table provider specified. You can set spark.sql.legacy.createHiveTableByDefault to false so that native data source table will be created instead.
22/11/10 14:04:28 WARN HiveMetaStore: Location: file:/Users/serge.rielau/spark/spark-warehouse/tttd specified for non-external table:tttd
Time taken: 0.078 seconds
spark-sql> INSERT INTO tttd VALUES(null);
Time taken: 0.36 seconds
spark-sql> SELECT * FROM tttd;
NULL
Time taken: 0.074 seconds, Fetched 1 row(s)
spark-sql>
Does hive not support NOT NULL? That's fine, but then we should fail on CREATE TABLE