[SPARK-18053] ARRAY equality is broken in Spark 2.0

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0, 2.0.1
• Fix Version/s: 2.0.3, 2.1.0
• Component/s: SQL
• Labels: correctness
• Target Version/s: 2.1.0
• Assignee: Wenchen Fan
• Reporter: Cheng Lian
• Created: 21/Oct/16 16:57
• Updated: 23/Nov/16 12:16
• Resolved: 23/Nov/16 12:16

Description

The following Spark shell reproduces this issue:

case class Test(a: Seq[Int])
Seq(Test(Seq(1))).toDF().createOrReplaceTempView("t")

sql("SELECT a FROM t WHERE a = array(1)").show()
// +---+
// |  a|
// +---+
// +---+

sql("SELECT a FROM (SELECT array(1) AS a) x WHERE x.a = array(1)").show()
// +---+
// |  a|
// +---+
// |[1]|
// +---+

Issue Links

• links to: [Github] Pull Request #15929 (cloud-fan)