[GSOC-175] GSOC: Support etcd as registry

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Labels: DolphinScheduler full-time gsoc2022
• Assignee: Unassigned
• Reporter: Wenjun Ruan
• Created: 17/Mar/22 15:21
• Updated: 21/Mar/23 08:11

Description

Apache DolphinScheduler

Apache DolphinScheduler is a distributed and extensible workflow scheduler platform with powerful DAG visual interfaces, dedicated to solving complex job dependencies in the data pipeline and providing various types of jobs available out of box.

Website: https://dolphinscheduler.apache.org/en-us/index.html

GitHub: https://github.com/apache/dolphinscheduler

Linked GitHub Issue: https://github.com/apache/dolphinscheduler/issues/8975

Background

Right now, we use zookeeper as registry, and we also use zookeeper to store some metadata of master and worker.

We have already implemented the registry plug-in architecture, it's needed to support Etcd as a new registry plugin choose. This can help user who only familiar with Etcd to use DolphinScheduler.

Task

This task is aim to support etcd as registry.

Recommended Skills

• Familiar with Java{}
• Know how to use Etcd

Mentors

Wenjun Ruan, [e-mail]

ShunFeng Cai, [e-mail]