[SPARK-16390] Dataset API improvements

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Done
• Component/s: SQL
• Assignee: Unassigned
• Reporter: Reynold Xin
• Created: 06/Jul/16 06:13
• Updated: 09/Sep/19 16:30
• Resolved: 09/Sep/19 16:30

Description

This is an umbrella ticket for improving the user experience of Dataset API.

Sub-Tasks

• Support mapValues on KeyValueGroupedDataset: Resolved
• Aggregator doesn't play nice with Option: Resolved
• Add Encoder for input type to Aggregator: Resolved
• KeyValueGroupedDataset.reduceGroups should support partial aggregation: Resolved
• Global Aggregation doesn't seem to work at all: Closed
• Aggregator with null initialisation will result in null: Resolved