[HUDI-7135] Spark reads hudi table error when flink creates the table without preCombine fields by catalog or factory

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.14.1, 1.0.0
• Labels: pull-request-available
• Assignee: Unassigned
• Reporter: 陈磊
• Created: 22/Nov/23 15:35
• Updated: 21/Dec/23 15:19
• Resolved: 08/Dec/23 03:01

Description

Create a table through dfs catalog, hms catalog, or sink ddl, and then query the data of the table through spark, and an exception occurs：
Java. util. NoSuchElementException: key not found: ts

demo:
1. create a table through hms catalog:

hms catalog create table

CREATE CATALOG hudi_catalog WITH(
'type' = 'hudi',
'mode' = 'hms'
);

CREATE TABLE hudi_catalog.`default`.ct1
(
f1 string,
f2 string
) WITH (
'connector' = 'hudi',
'path' = 'file:///Users/x/x/others/data/hudi-warehouse/ct1',
'table.type' = 'COPY_ON_WRITE',
'write.operation' = 'insert'
);

2. spark query

spark query

select * from ct1

3. exception

exception

java.util.NoSuchElementException: key not found: ts

Issue Links

• links to: GitHub Pull Request #10157