[DUBBO-136] Python integration & AI Traffic Management

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Labels: AI Dubbo full-time gsoc2024
• Assignee: Unassigned
• Reporter: Albumen Kevin
• Created: 04/Feb/24 08:34
• Updated: 04/Feb/24 09:07

Description

Background

Dubbo is a an easy-to-use, high-performance remote procedure call framework. Most of the AI frameworks are running on Python and suffering unbalanced load for GPUs.

Objectives

1. Enhance Dubbo on Python[1] and support the brand new Triple protocol in Dubbo-Java
2. Introduce a new load balance algorithm for AI, which can gather the metrics from GPUs and select the most idle one to invoke

[1] https://github.com/apache/dubbo-python

Recommended Skills

1. Familiar with Python
2. Have a basic understanding of RPC
3. Have a basic understanding of traffic management

 

Mentor

• Mentor: Albumen Kevin, Apache Dubbo PMC, [e-mail]
• Mailing List: [e-mail]