[HUDI-7269] Fallback to key-based merging if there is no positions in log header - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Blocker
Resolution: Done
Affects Version/s: None
Fix Version/s: 1.0.0-beta2, 1.0.0
Component/s: None
Labels:
- pull-request-available

Epic Link:
filegroup-reader-writer-completion-time

Description

When turning on merging with record positions, if there is no position header in the log blocks, the reader should fall back to key-based merging.

Attachments

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

image (6).png
10/Apr/24 20:56
2.45 MB
Jonathan Vexler
image (7).png
10/Apr/24 20:57
1.12 MB
Jonathan Vexler
image (8).png
10/Apr/24 20:58
360 kB
Jonathan Vexler
image (9).png
10/Apr/24 21:00
2.03 MB
Jonathan Vexler

Issue Links

causes

HUDI-8003 Add overwrite payload for hive for record reader

Closed

links to

GitHub Pull Request #10991

GitHub Pull Request #11415

Activity

People

Assignee:: Jonathan Vexler

Reporter:: Ethan Guo (this is the old account; please use "yihua")

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 31/Dec/23 23:54

Updated:: 18/Jul/24 15:55

Resolved:: 11/Jun/24 13:31