Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-41288 Server-specific improvement, error handling and API
  3. SPARK-40532

Python version for UDF should follow the servers version

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.4.0
    • None
    • Connect
    • None

    Description

      Currently, we artificially pin the Python version to 3.9 in the UDF generation code, but this should actually be the correct server vs client version.

       

      In addition the version should be configured as part of the function definition proto message.

      Attachments

        Activity

          People

            Unassigned Unassigned
            grundprinzip-db Martin Grund
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: