Description
Seems we do not do type coercion for ScalaUDFs. The following code will hit a runtime exception.
import org.apache.spark.sql.functions._ val myUDF = udf((x: Int) => x + 1) val df = sqlContext.range(1, 10).toDF("i").select(myUDF($"i")) df.explain(true) df.show
It is also good to check if we do type coercion for PythonUDFs.