[HUDI-2866] Get Metadata table bootstrapping in Flink in parity with spark

• Type: Improvement
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.14.0
• Component/s: flink, metadata
• Story Points: 8
• Epic Link: Metadata Table for File Listing & Query Planning
• Assignee: Danny Chen
• Reporter: sivabalan narayanan

Reviewers

Ethan Guo

• Created: 26/Nov/21 12:09
• Updated: 16/Mar/23 09:52
• Resolved: 16/Mar/23 09:52

Description

Please revisit flink code and ensure we are having parity with spark. Especially around metadata table bootstrap. I don't see concurrency support in flink and so, these changes are not as mandatory as we need in spark, but nevertheless, good to be in sync. 

 

Related tickets:

https://github.com/apache/hudi/pull/4114

https://github.com/apache/hudi/pull/4124

 

Issue Links

• is blocked by: HUDI-3790 Flink MT writer does not properly partition records