[SPARK-19435] Type coercion between ArrayTypes

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.2.0
• Fix Version/s: 2.2.0
• Component/s: SQL
• Assignee: Hyukjin Kwon
• Reporter: Hyukjin Kwon
• Created: 02/Feb/17 10:20
• Updated: 12/Dec/22 17:51
• Resolved: 13/Feb/17 21:11

Description

It seems currently we don't allow type coercion between arrays. We now implicitly cast it in SPARK-18624

So, the below codes are not working now.

Seq(Array(1)).toDF("a").selectExpr("greatest(a, array(1D))")
Seq(Array(1)).toDF("a").selectExpr("least(a, array(1D))")
sql("SELECT * FROM values (array(0)), (array(1D)) as data(a)")
Seq(Array(1)).toDF("a").union(Seq(Array(1D)).toDF("b"))
sql("SELECT IF(1=1, array(1), array(1D))")

Issue Links

• is related to: SPARK-19536 Improve capability to merge SQL data types
• links to: [Github] Pull Request #16777 (HyukjinKwon)