Uploaded image for project: 'Community Development'
  1. Community Development
  2. COMDEV-343

Apache RocketMQ Connect Hudi

    XMLWordPrintableJSON

    Details

      Description

      Context

      Hudi could ingest and manage the storage of large analytical datasets over DFS (hdfs or cloud stores). It can act as either a source or sink for streaming processing platform such as Apache RocketMQ. it also can be used as a state store inside a processing DAG (similar to how rocksDB is used by Flink). This is an item on the roadmap of the Apache RocketMQ. This time, you should implement a fully hudi source and sink based on RocketMQ connect framework, which is a most important implementation of the OpenConnect.

      You should learn before applying for this topic

      Apache RocketMQ Connect Framework
      Apache Hudi
      .

      Mentor

      vongosling@apache.orgduhengforever@apache.org

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              duheng duheng
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated: