[HUDI-6905] Timeline based checkpoint metadata should not rely on file system ckp files

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Duplicate
• Component/s: flink
• Assignee: Unassigned
• Reporter: Qijun Fu
• Created: 29/Sep/23 08:50
• Updated: 09/Oct/23 09:33
• Resolved: 09/Oct/23 09:33

Description

Discuss: https://github.com/apache/hudi/pull/9651 

 

We can implement a complete timeline server memory-based checkpoint metadata since we will delete all previous ckp metadata when bootstrapping(so we do not actually rely on a durable filesystem state). And the timeline server is actually stable enough to serve the checkpoint message requests.