[HUDI-6765] Add merge mode to allow differentiation of dedup logic

• Type: Task
• Status: Closed
• Priority: Blocker
• Resolution: Won't Do
• Fix Version/s: 1.0.0
• Labels: hudi-1.0.0-beta2
• Story Points: 8
• Epic Link: RFC-46: Engine Native Record Payloads
• Assignee: Lin Liu
• Reporter: Y Ethan Guo
• Created: 29/Aug/23 01:09
• Updated: 01/Oct/24 03:25
• Resolved: 01/Oct/24 03:25

Description

The new merge API in HoodieRecordMerger can only differentiate merge logic based on `OperationModeAwareness`, which introduces another layer of complexity. Instead, could we add a new argument of merge mode (pre-combine, or update) to the merge API for customized dedup (or merging of log records?), instead of using OperationModeAwareness?

Issue Links

• mentioned in: Page Loading...