[HUDI-1355] Allowing multipleSourceOrdering fields for doing the preCombine on payload

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 0.9.0
• Component/s: Common Core, Utilities
• Labels: new-to-hudi patch starter
• Assignee: Unassigned
• Reporter: Bala Mahesh Jampani
• Created: 24/Oct/20 01:29
• Updated: 12/Mar/22 13:09
• Resolved: 27/Nov/21 04:59

Description

Hi,

I have come across the use case where some of the incoming events have same timestamps for the insert and update event. In this case I want to depend on the other field for ordering. In simple terms, if the primary sort ties, i want to do secondary sort based on other field, if that too ties, go to the other field etc.,. it would be good if hudi has this functionality.

Issue Links

• is duplicated by: HUDI-1588 Support multiple ordering fields via payload class config
• is related to: HUDI-1573 Spark Sql Writer support Multi preCmp Field