Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-44816

Cryptic error message when UDF associated class is not found

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 3.5.0
    • 3.5.0
    • Connect
    • None

    Description

      When a Dataset API is used that either requires or is modeled as a UDF, the class defining the UDF/function should be uploaded to the service fist using the `addArtifact()` API.

      When this is not done, an error is thrown. However, this error message is cryptic and is not clear about the problem.

      Improve this error message to make it clear that an expected class was not found.

      Attachments

        Activity

          People

            nija Niranjan Jayakar
            nija Niranjan Jayakar
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: