[GSOC-239] Apache RocketMQ Connect Hudi

• Type: Wish
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Labels: RocketMQ gsoc2020
• Assignee: Unassigned
• Reporter: duheng
• Created: 21/Feb/20 03:43
• Updated: 21/Mar/23 08:11

Description

Context

Hudi could ingest and manage the storage of large analytical datasets over DFS (hdfs or cloud stores). It can act as either a source or sink for streaming processing platform such as Apache RocketMQ. it also can be used as a state store inside a processing DAG (similar to how rocksDB is used by Flink). This is an item on the roadmap of the Apache RocketMQ. This time, you should implement a fully hudi source and sink based on RocketMQ connect framework, which is a most important implementation of the OpenConnect.

You should learn before applying for this topic

Apache RocketMQ Connect Framework
Apache Hudi
.

Mentor

[e-mail], [e-mail]