[SPARK-23122] Deprecate register* for UDFs in SQLContext and Catalog in PySpark

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.3.0
• Component/s: PySpark, SQL
• Target Version/s: 2.3.0
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 17/Jan/18 04:13
• Updated: 12/Dec/22 17:50
• Resolved: 18/Jan/18 05:55

Description

Deprecate register* for UDFs in SQLContext and Catalog in PySpark

Seems we allow many other ways to register UDFs in SQL statements. Some are in SQLContext and some are in Catalog.

These are also inconsistent with Java / Scala APIs. Seems we better deprecating them and put the logics into UDFRegistration (spark.udf.register*).

Please see this discussion too - https://github.com/apache/spark/pull/20217#issuecomment-357134926.

Issue Links

• links to: [Github] Pull Request #20288 (HyukjinKwon)
• links to: [Github] Pull Request #20348 (gatorsmile)
• links to: [Github] Pull Request #20523 (gatorsmile)