Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
Description
Support OverwriteWithGreaterRecordPayload for Hudi:
In DefaultHoodieRecordPayload only support precombine key incoming >= persist,this can not use in the sence which need keep the earliest record when incoming = persist.
eg: earliest login time
id | precombine | ts | login_time | |
---|---|---|---|---|
1 | 123 | 11 | 123456 | |
1 | 123 | 11 | 123666 |
In this sence need keep the first record,so we need a new payload
Attachments
Issue Links
- links to