[SPARK-14642] import org.apache.spark.sql.expressions._ breaks udf under functions

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: SQL
• Target Version/s: 2.0.0
• Assignee: Subhobrata Dey
• Reporter: Yin Huai
• Created: 14/Apr/16 21:31
• Updated: 10/May/16 19:35
• Resolved: 10/May/16 19:34

Description

The following code works

scala> import org.apache.spark.sql.functions._
import org.apache.spark.sql.functions._

scala> udf((v: String) => v.stripSuffix("-abc"))
res0: org.apache.spark.sql.expressions.UserDefinedFunction = UserDefinedFunction(<function1>,StringType,Some(List(StringType)))

But, the following does not

scala> import org.apache.spark.sql.functions._
import org.apache.spark.sql.functions._

scala> import org.apache.spark.sql.expressions._
import org.apache.spark.sql.expressions._

scala> udf((v: String) => v.stripSuffix("-abc"))
<console>:30: error: No TypeTag available for String
       udf((v: String) => v.stripSuffix("-abc"))

Issue Links

• relates to: SPARK-13611 import Aggregator doesn't work in Spark Shell
• links to: [Github] Pull Request #12458 (sbcd90)