[SPARK-23736] High-order function: concat(array1, array2, ..., arrayN) → array

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.4.0
• Component/s: SQL
• Target Version/s: 2.4.0
• Assignee: Marek Novotny
• Reporter: Marek Novotny
• Created: 19/Mar/18 12:05
• Updated: 21/Sep/18 02:14
• Resolved: 20/Apr/18 05:58

Description

Extend the concat function to also support array columns.

Example:

concat(array(1, 2, 3), array(10, 20, 30), array(100, 200)) => [1, 2, 3,10, 20, 30,100, 200] 

Issue Links

• is related to: SPARK-25469 Eval methods of Concat, Reverse and ElementAt should use pattern matching only once
• links to: [Github] Pull Request #20858 (mn-mikke)
• links to: [Github] Pull Request #21181 (mgaido91)