[HUDI-3451] Add checks for metadata table init to avoid possible out-of-sync

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.11.0
• Labels: pull-request-available
• Story Points: 2
• Epic Link: Metadata Table for File Listing & Query Planning
• Assignee: Ethan Guo (this is the old account; please use "yihua")
• Reporter: Ethan Guo (this is the old account; please use "yihua")
• Created: 17/Feb/22 22:31
• Updated: 02/Apr/22 19:01
• Resolved: 02/Apr/22 19:01

Description

Around guarding enabling and disabling MDT. i.e. if someone enabled MDT and after few commits disables MDT and then re-enables it, we should re-bootstrap the MDT. So, we were wondering if we can add the "metadata.enable" property to table config. So, when someone disable MDT, we can clean up the MDT right away.  We don't leave any trails and don't need to worry about when the user will re-enable it back. 

Issue Links

• relates to: HUDI-3782 Update metadata partitions table config when any of them is enabled/disabled
• links to: GitHub Pull Request #5186