Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31965

Run the tests in registerJavaFunction and registerJavaUDAF only when test classes are complied

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 2.4.6, 3.0.0
    • 3.0.0
    • PySpark, Tests
    • None

    Description

      If you do a plain package with sbt:

      ./build/sbt -DskipTests -Phive-thriftserver clean package
      ./run-tests --python-executable=python3 --testname="pyspark.sql.udf UserDefinedFunction"
      

      The doctests in registerJavaFunction and registerJavaUDAF fail because it requires some classes from the test compilation.

      We should skip them conditionally

      Attachments

        Activity

          People

            hyukjin.kwon Hyukjin Kwon
            hyukjin.kwon Hyukjin Kwon
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: