[SPARK-18932] Partial aggregation for collect_set / collect_list

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.2.0
• Component/s: SQL, Structured Streaming
• Target Version/s: 2.2.0
• Assignee: L. C. Hsieh
• Reporter: Michael Armbrust
• Created: 20/Dec/16 00:24
• Updated: 03/Jan/17 14:13
• Resolved: 03/Jan/17 14:13

Description

The lack of partial aggregation here is blocking us from using these in streaming. It still won't be fast, but it would be nice to at least be able to use them.

Issue Links

• links to: [Github] Pull Request #16371 (viirya)