[HUDI-5706] Support record level conflict resolution strategy

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: multi-writer, writer-core
• Assignee: Unassigned
• Reporter: sivabalan narayanan
• Created: 06/Feb/23 03:11
• Updated: 06/Feb/23 03:11

Description

As of now, if there are two concurrent writers inserting duplicate set of records, both will succeed and table could contain duplicates. 

 

We should add a new conflict resolution strategy where we do record level conflict resolution. It might be very expensive, but some users might use this strategy.