[SPARK-4676] JavaSchemaRDD.schema may throw NullType MatchError if sql has null

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.2.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: YanTang Zhai
• Created: 01/Dec/14 13:19
• Updated: 02/Dec/14 22:17
• Resolved: 02/Dec/14 22:17

Description

val jsc = new org.apache.spark.api.java.JavaSparkContext(sc)
val jhc = new org.apache.spark.sql.hive.api.java.JavaHiveContext(jsc)
val nrdd = jhc.hql("select null from spark_test.for_test")
println(nrdd.schema)
Then the error is thrown as follows:
scala.MatchError: NullType (of class org.apache.spark.sql.catalyst.types.NullType$)
at org.apache.spark.sql.types.util.DataTypeConversions$.asJavaDataType(DataTypeConversions.scala:43)

Issue Links

• links to: [Github] Pull Request #3538 (YanTangZhai)