[SPARK-23912] High-order function: array_distinct(x) → array

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.4.0
• Component/s: SQL
• Target Version/s: 2.4.0
• Assignee: Huaxin Gao
• Reporter: Xiao Li
• Created: 09/Apr/18 06:29
• Updated: 12/Mar/19 10:43
• Resolved: 21/Jun/18 03:26

Description

Ref: https://prestodb.io/docs/current/functions/array.html

Remove duplicate values from the array x.

Issue Links

• causes: SPARK-27134 array_distinct function does not work correctly with columns containing array of array
• links to: [Github] Pull Request #21050 (huaxingao)
• links to: [Github] Pull Request #22044 (kiszk)