[HUDI-6575] Prempt the condition to check whether MDT can be rolled back before running rollback in data table - ASF JIRA

Log work

Agile Board

Rank to Top

Rank to Bottom

Attach files

Attach Screenshot

Bulk Copy Attachments

Bulk Move Attachments

Add vote

Voters

Watch issue

Watchers

Create sub-task

Convert to sub-task

Link

Clone

Labels

Update Comment Author

Replace String in Comment

Update Comment Visibility

Delete Comments

XML

Word

Printable

JSON

Details

Type: Task
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: 1.1.0
Component/s: metadata
Labels:
None

Description

Currently, while restoring, after we have processed N rollbacks in data table (rollbacks are not yet committed), we call metadata writer update method which then checks if there is at least a base file upto the point being restored. If not, then it aborts and the N rollback processing is wasted. The check in metadata writer update can be moved upfront.