[FLINK-14017] Support to start up Python worker in process mode

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Resolved
• Fix Version/s: 1.10.0
• Component/s: API / Python
• Labels: pull-request-available
• Assignee: Wei Zhong
• Reporter: Dian Fu
• Created: 09/Sep/19 13:28
• Updated: 18/Sep/19 15:11
• Resolved: 18/Sep/19 15:11

Description

We employ Apache Beam's portability frameowork for the Python UDF execution. However, there is only a golang implementation for the boot script to start up SDK harness in Beam. It’s used by both the Python SDK harness and the Go SDK harness. This is not a problem for Beam. However, it’s indeed a problem for Flink as it indicates that the whole stack of Beam’s Go SDK harness will be depended if we use the golang implementation of the boot script. We want to avoid this by adding a Python boot script.

Issue Links

• links to: GitHub Pull Request #9655