[FLINK-14026] Manage the resource of Python worker properly

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Resolved
• Fix Version/s: 1.10.0
• Component/s: API / Python
• Labels: pull-request-available
• Assignee: Dian Fu
• Reporter: Dian Fu
• Created: 09/Sep/19 13:49
• Updated: 07/Dec/19 05:06
• Resolved: 07/Dec/19 05:06

Description

For a Flink Table API & SQL job, if it uses Python user-defined functions, the Java operator will launch separate Python process for Python user-defined function execution. We should make sure that the resources used by the Python process are managed by Flink’s resource management framework.

Issue Links

• links to: GitHub Pull Request #10453