[SPARK-4185] JSON schema inference failed when dealing with type conflicts in arrays

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.2.0
• Component/s: SQL
• Assignee: Yin Huai
• Reporter: Yin Huai
• Created: 01/Nov/14 18:40
• Updated: 02/Nov/14 23:47
• Resolved: 02/Nov/14 23:47

Description

val sqlContext = new org.apache.spark.sql.SQLContext(sparkContext)
val diverging = sparkContext.parallelize(List("""{"branches": ["foo"]}""", """{"branches": [{"foo":42}]}"""))
sqlContext.jsonRDD(diverging)  // throws a MatchError

The case is from http://chapeau.freevariable.com/2014/10/fedmsg-and-spark.html

Issue Links

• links to: [Github] Pull Request #3056 (yhuai)