[FLINK-14018] Add Python building blocks to make sure the basic functionality of Python ScalarFunction could work

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Resolved
• Fix Version/s: 1.10.0
• Component/s: API / Python
• Labels: pull-request-available
• Assignee: Dian Fu
• Reporter: Dian Fu
• Created: 09/Sep/19 13:31
• Updated: 01/Oct/19 11:27
• Resolved: 29/Sep/19 15:34

Description

We need to add a few Python building blocks such as ScalarFunctionOperation, RowCoder, etc for Python ScalarFunction execution. ScalarFunctionOperation is subclass of Operation in Beam and RowCoder, etc are subclasses of Coder in Beam. These classes will be registered into the Beam’s portability framework to make sure they take effects.

This PR makes sure that a basic end to end Python UDF could be executed.

Issue Links

• causes: FLINK-14306 flink-python build fails with No module named pkg_resources
• links to: GitHub Pull Request #9766