Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4366 Aggregation Improvement
  3. SPARK-9830

Remove AggregateExpression1 and Aggregate Operator used to evaluate AggregateExpression1s

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.6.0
    • Component/s: SQL
    • Labels:
      None
    • Target Version/s:

      Description

      In 1.6.0, we should remove the old aggregation code path (used to evaluate AggregateExpression1). While removing this code path, there are several code clean up we need to do,
      1. Remove all of our hacks from ResolveFunctions.
      2. Remove all of the conversion logics from {org.apache.spark.sql.catalyst.expressions.aggregate.utils}}.
      3. Remove newAggregation field from logical.Aggregate.
      4. Remove the query planning rule for old aggregate path.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                yhuai Yin Huai
                Reporter:
                yhuai Yin Huai
              • Votes:
                0 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: