[SPARK-21692] Modify PythonUDF to support nullability

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.2.0
• Component/s: PySpark, SQL
• Labels: bulk-closed
• Assignee: Unassigned
• Reporter: Michael Styles
• Created: 10/Aug/17 15:21
• Updated: 25/May/21 01:52
• Resolved: 25/May/21 01:38

Description

When creating or registering Python UDFs, a user may know whether null values can be returned by the function. PythonUDF and related classes should be modified to support nullability.

Issue Links

• links to: [Github] Pull Request #18906 (ptkool)
• links to: GitHub Pull Request #18906