Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-41661 Support for User-defined Functions in Python
  3. SPARK-42124

Scalar Inline Python UDF in Spark Connect

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • Connect, PySpark
    • None

    Description

      Support scalar inline user-defined function of Python(a.k.a., unregistered Python UDF) in Spark Connect.

      Currently, the user-specified return type must be of `pyspark.sql.types.DataType`.

      Attachments

        Activity

          People

            XinrongM Xinrong Meng
            XinrongM Xinrong Meng
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: