Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18777

Return UDF objects when registering from Python

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • None
    • PySpark, SQL
    • None

    Description

      In Scala when registering a UDF it gives you back a UDF object that you can use in the Dataset/DataFrame API as well as with SQL expressions. We can do the same in Python, for both Python UDFs and Java UDFs registered from Python.

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue SPARK-19161 Improving UDF Docstrings

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-19159 PySpark UDF API improvements

          • Major - Major loss of function.
          • Resolved
          links to

          Pull request #17831 [Github] Pull Request #17831 (zero323)

          Activity

            People

              zero323 Maciej Szymkiewicz
              holden Holden Karau
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: