[SPARK-8283] udf_struct test failure

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: SQL
• Target Version/s: 1.5.0
• Sprint: Spark 1.5 release
• Assignee: Yijie Shen
• Reporter: Reynold Xin
• Created: 09/Jun/15 23:20
• Updated: 18/Jun/15 11:41
• Resolved: 18/Jun/15 06:48

Description

[info] - udf_struct *** FAILED *** (704 milliseconds)
[info]   Failed to execute query using catalyst:
[info]   Error: org.apache.spark.sql.catalyst.expressions.Literal cannot be cast to org.apache.spark.sql.catalyst.expressions.NamedExpression
[info]   java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.Literal cannot be cast to org.apache.spark.sql.catalyst.expressions.NamedExpression
[info]   	at org.apache.spark.sql.catalyst.expressions.CreateStruct$$anonfun$1.apply(complexTypes.scala:64)
[info]   	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
[info]   	at scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:244)
[info]   	at scala.collection.immutable.List.foreach(List.scala:318)
[info]   	at scala.collection.TraversableLike$class.map(TraversableLike.scala:244)
[info]   	at scala.collection.AbstractTraversable.map(Traversable.scala:105)
[info]   	at org.apache.spark.sql.catalyst.expressions.CreateStruct.dataType$lzycompute(complexTypes.scala:64)
[info]   	at org.apache.spark.sql.catalyst.expressions.CreateStruct.dataType(complexTypes.scala:61)
[info]   	at org.apache.spark.sql.catalyst.expressions.CreateStruct.dataType(complexTypes.scala:55)
[info]   	at org.apache.spark.sql.catalyst.expressions.ExtractValue$.apply(ExtractValue.scala:43)
[info]   	at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveReferences$$anonfun$apply$8$$anonfun$applyOrElse$4.applyOrElse(Analyzer.scala:353)
[info]   	at org.apache.spark.sql.catalyst.analysis.Analyzer$ResolveReferences$$anonfun$apply$8$$anonfun$applyOrElse$4.applyOrElse(Analyzer.scala:340)
[info]   	at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$transformUp$1.apply(TreeNode.scala:286)
[info]   	at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$transformUp$1.apply(TreeNode.scala:286)
[info]   	at org.apache.spark.sql.catalyst.trees.CurrentOrigin$.withOrigin(TreeNode.scala:51)
[info]   	at org.apache.spark.sql.catalyst.trees.TreeNode.transformUp(TreeNode.scala:285)
[info]   	at org.apache.spark.sql.catalyst.trees.TreeNode$$anonfun$5.apply(TreeNode.scala:299)
[info]   	at scala.collection.Iterator$$anon$11.next(Iterator.scala:328)
[info]   	at scala.collection.Iterator$class.foreach(Iterator.scala:727)
[info]   	at scala.collection.AbstractIterator.foreach(Iterator.scala:1157)
[info]   	at scala.collection.generic.Growable$class.$plus$plus$eq(Growable.scala:48)
[info]   	at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:103)
[info]   	at scala.collection.mutable.ArrayBuffer.$plus$plus$eq(ArrayBuffer.scala:47)
[info]   	at scala.collection.TraversableOnce$class.to(TraversableOnce.scala:273)
[info]   	at scala.collection.AbstractIterator.to(Iterator.scala:1157)
[info]   	at scala.collection.TraversableOnce$class.toBuffer(TraversableOnce.scala:265)

Issue Links

• links to: [Github] Pull Request #6828 (yijieshen)
• links to: [Github] Pull Request #6881 (chenghao-intel)