[FLINK-6229] Rework setup&configuration of PythonPlanBinder/operators

• Type: Improvement
• Status: Closed
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.3.0
• Fix Version/s: 1.3.0
• Component/s: API / Python
• Assignee: Chesnay Schepler
• Reporter: Chesnay Schepler
• Created: 31/Mar/17 09:23
• Updated: 06/Apr/17 09:01
• Resolved: 06/Apr/17 09:01

Description

The Python API has a few problems in regards to the setup and configuration.

The PythonPlanBinder has several non-final static fields that store critical information; which python version to use, the path for the distributed cache, etc. that are directly accessed by operators instead of passing them on explicitly or storing them in a configuration.

The naming of methods & arguments in the file setup phase (copy to local tmp location, upload to DFS, register at DC) is less readable than it could be.

The binary path configuration can be stream-lined to use a single key instead of one each for python2 and python 3.