[SPARK-9830] Remove AggregateExpression1 and Aggregate Operator used to evaluate AggregateExpression1s

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.6.0
• Component/s: SQL
• Target Version/s: 1.6.0
• Assignee: Yin Huai
• Reporter: Yin Huai
• Created: 11/Aug/15 18:15
• Updated: 11/Nov/15 06:14
• Resolved: 10/Nov/15 19:07

Description

In 1.6.0, we should remove the old aggregation code path (used to evaluate AggregateExpression1). While removing this code path, there are several code clean up we need to do,
1. Remove all of our hacks from ResolveFunctions.
2. Remove all of the conversion logics from {org.apache.spark.sql.catalyst.expressions.aggregate.utils}}.
3. Remove newAggregation field from logical.Aggregate.
4. Remove the query planning rule for old aggregate path.

Issue Links

• is blocked by: SPARK-9241 Supporting multiple DISTINCT columns
• is blocked by: SPARK-11017 Support ImperativeAggregates in TungstenAggregate
• is related to: SPARK-11645 Remove OpenHashSet for the old aggregate.
• links to: [Github] Pull Request #9556 (yhuai)
• links to: [Github] Pull Request #9607 (yhuai)