[SPARK-12491] UDAF result differs in SQL if alias is used

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.5.2
• Fix Version/s: 1.5.3, 1.6.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Tristan
• Created: 22/Dec/15 22:28
• Updated: 28/Dec/15 22:26
• Resolved: 28/Dec/15 22:26

Description

Using the GeometricMean UDAF example (https://databricks.com/blog/2015/09/16/spark-1-5-dataframe-api-highlights-datetimestring-handling-time-intervals-and-udafs.html), I found the following discrepancy in results:

scala> sqlContext.sql("select group_id, gm(id) from simple group by group_id").show()
+--------+---+
|group_id|_c1|
+--------+---+
|       0|0.0|
|       1|0.0|
|       2|0.0|
+--------+---+


scala> sqlContext.sql("select group_id, gm(id) as GeometricMean from simple group by group_id").show()
+--------+-----------------+
|group_id|    GeometricMean|
+--------+-----------------+
|       0|8.981385496571725|
|       1|7.301716979342118|
|       2|7.706253151292568|
+--------+-----------------+

Issue Links

• duplicates: SPARK-11885 UDAF may nondeterministically generate wrong results