Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23122

Deprecate register* for UDFs in SQLContext and Catalog in PySpark

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.0
    • Fix Version/s: 2.3.0
    • Component/s: PySpark, SQL
    • Labels:
      None
    • Target Version/s:

      Description

      Deprecate register* for UDFs in SQLContext and Catalog in PySpark

      Seems we allow many other ways to register UDFs in SQL statements. Some are in SQLContext and some are in Catalog.

      These are also inconsistent with Java / Scala APIs. Seems we better deprecating them and put the logics into UDFRegistration (spark.udf.register*).

      Please see this discussion too - https://github.com/apache/spark/pull/20217#issuecomment-357134926.

        Attachments

          Activity

            People

            • Assignee:
              hyukjin.kwon Hyukjin Kwon
              Reporter:
              hyukjin.kwon Hyukjin Kwon
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: