Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23122

Deprecate register* for UDFs in SQLContext and Catalog in PySpark

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 2.3.0
    • PySpark, SQL
    • None

    Description

      Deprecate register* for UDFs in SQLContext and Catalog in PySpark

      Seems we allow many other ways to register UDFs in SQL statements. Some are in SQLContext and some are in Catalog.

      These are also inconsistent with Java / Scala APIs. Seems we better deprecating them and put the logics into UDFRegistration (spark.udf.register*).

      Please see this discussion too - https://github.com/apache/spark/pull/20217#issuecomment-357134926.

      Attachments

        Activity

          People

            hyukjin.kwon Hyukjin Kwon
            hyukjin.kwon Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: