[HUDI-1521] [UMBRELLA] RFC-24 HUDI Flink writer proposal

• Type: Epic
• Status: Closed
• Priority: Major
• Resolution: Implemented
• Fix Version/s: 0.8.0
• Component/s: flink
• Assignee: Danny Chen
• Reporter: Danny Chen
• Created: 11/Jan/21 07:18
• Updated: 09/May/22 09:21
• Resolved: 24/Mar/21 14:07

Description

As the RFC-24 has described [1], we would promote the Flink writer as following:

1. Remove the single parallelism operator and add test framework
2. Make the write task scalable
3. Write as mini-batch
4. Add a new index

So this is an umbrella issue, we would fix each as sub-tasks.

[1] https://cwiki.apache.org/confluence/display/HUDI/RFC+-+24%3A+Hoodie+Flink+Writer+Proposal

Issue Links

• relates to: HUDI-184 Integrate Hudi with Apache Flink