[HIVE-10427] collect_list() and collect_set() should accept struct types as argument

• Type: Wish
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.3.0, 2.0.0
• Component/s: UDF
• Labels: TODOC1.3
• Hadoop Flags: Reviewed
• Assignee: Chao Sun
• Reporter: Alexander Behm
• Created: 21/Apr/15 21:22
• Updated: 02/Nov/17 14:00
• Resolved: 05/Jun/15 17:40

Description

The collect_list() and collect_set() functions currently only accept scalar argument types. It would be very useful if these functions could also accept struct argument types for creating nested data from flat data.
For example, suppose I wanted to create a nested customers/orders table from two flat tables, customers and orders. Then it'd be very convenient to write something like this:

insert into table nested_customers_orders
select c.*, collect_list(named_struct("oid", o.oid, "order_date": o.date...))
from customers c inner join orders o on (c.cid = o.oid)
group by c.cid

Thanks you for your consideration.

Issue Links

• is blocked by: HIVE-10788 Change sort_array to support non-primitive types
• links to: RB