[FLINK-14019] Python environment and dependency management

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Resolved
• Fix Version/s: 1.10.0
• Component/s: API / Python
• Labels: pull-request-available
• Assignee: Wei Zhong
• Reporter: Dian Fu
• Created: 09/Sep/19 13:33
• Updated: 12/Dec/19 12:14
• Resolved: 05/Dec/19 01:34

Description

A Python user-defined functions may depend on third party dependencies. We should provide a proper way to handle it:

1. Provide a way to let users specifying the dependencies
2. Provide a way to let users specifying the Python used

Issue Links

• is blocked by: FLINK-14240 The configuration added via TableConfig#configuration should be added to GlobalJobParameters for the legacy planner
• is blocked by: FLINK-14033 Distributed caches are not registered in Yarn Per Job Cluster Mode
• links to: GitHub Pull Request #10017
• links to: GitHub Pull Request #10430