[HUDI-4569] [RFC-59] Multiple event_time fields latest verification in a single table

• Type: Epic
• Status: In Progress
• Priority: Major
• Resolution: Unresolved
• Labels: features pull-request-available
• Epic Name: RFC-59 multiple event time fields
• Assignee: Richard Xinyao Tian
• Reporter: Richard Xinyao Tian

Reviewers

Shiyan Xu, Sivabalan Narayanan

• Created: 08/Aug/22 07:48
• Updated: 21/Dec/23 15:33

Description

This Jira tracks all sub-tasks related to RFC-59, which would help Hudi to achieve a new feature highly demanded by Finance related industries, temporarily named "Multiple event_time fields latest verification in a single table". This feature would improve Hudi to have the ability to verify multiple event_time fields as the latest, thus could enable Hudi to support scenarios where complex Join operations have been executed.

We're very keen to make this new feature available to everyone. Since we benefit from the Hudi community, so we really desire to give back to the community with our efforts.

For those who are interested in why this feature is desperately desired, please move to the new RFC Request discussion, which could be found in the link below: https://lists.apache.org/thread/dlkgn1knknhl3z2gwtvchd618tj399z9

 

Stages Management:

1. Briefly illustrate this idea in the dev-maillist and discuss it with comitters [Done]
2. Raise a PR to claim a RFC-number for further steps [Done]
3. Write formal RFC materials to describe design and code implementation [Done] 
4. Finish Writing RFC materials and request a PR for submitting them [Done]
5. Wait for comments from at least two PMCs and confirm of approval [Current Stage]

Issue Links

• links to: GitHub Pull Request #6328
• links to: RFC-59 literature materials with pictures