[HUDI-6765] Add merge mode to allow differentiation of dedup logic

• Type: Task
• Status: Open
• Priority: Blocker
• Resolution: Unresolved
• Fix Version/s: 1.0.0
• Labels: hudi-1.0.0-beta2
• Story Points: 2
• Epic Link: RFC-46: Engine Native Record Payloads
• Assignee: Ethan Guo
• Reporter: Ethan Guo
• Created: 29/Aug/23 01:09
• Updated: 25/Mar/24 11:19

Description

The new merge API in HoodieRecordMerger can only differentiate merge logic based on `OperationModeAwareness`, which introduces another layer of complexity. Instead, could we add a new argument of merge mode (pre-combine, or update) to the merge API for customized dedup (or merging of log records?), instead of using OperationModeAwareness?

Issue Links

• mentioned in: Page Loading...