[SPARK-14666] Using DISTINCT on a UDF (like CONCAT) is not supported

• Type: Bug
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.6.1
• Fix Version/s: 2.0.0
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Dominic Ricard
• Created: 15/Apr/16 19:06
• Updated: 08/Aug/16 18:45
• Resolved: 08/Aug/16 18:43

Description

The following query fails with:

Java::JavaSql::SQLException: org.apache.spark.sql.AnalysisException: cannot resolve 'column_1' given input columns: [_c0]; line # pos ##

Query:

select
  distinct concat(column_1, ' : ', column_2)
from
  table
order by
  concat(column_1, ' : ', column_2);