Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-6229

Rework setup&configuration of PythonPlanBinder/operators

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 1.3.0
    • Fix Version/s: 1.3.0
    • Component/s: Python API
    • Labels:
      None

      Description

      The Python API has a few problems in regards to the setup and configuration.

      The PythonPlanBinder has several non-final static fields that store critical information; which python version to use, the path for the distributed cache, etc. that are directly accessed by operators instead of passing them on explicitly or storing them in a configuration.

      The naming of methods & arguments in the file setup phase (copy to local tmp location, upload to DFS, register at DC) is less readable than it could be.

      The binary path configuration can be stream-lined to use a single key instead of one each for python2 and python 3.

        Activity

        Hide
        Zentol Chesnay Schepler added a comment -

        1.3:
        Setup was reworked in 5ff9c99ff193725c125f2b4c450411db97b6f3b4
        Configuration of API/operators was reworked in bdcebfda06846a1e21bb6a4678909d503ebc6333

        Show
        Zentol Chesnay Schepler added a comment - 1.3: Setup was reworked in 5ff9c99ff193725c125f2b4c450411db97b6f3b4 Configuration of API/operators was reworked in bdcebfda06846a1e21bb6a4678909d503ebc6333

          People

          • Assignee:
            Zentol Chesnay Schepler
            Reporter:
            Zentol Chesnay Schepler
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development