Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-13428

Pushdown Aggregate Functions in Sort into Aggregate

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Incomplete
    • Affects Version/s: 1.6.0, 2.0.0
    • Fix Version/s: None
    • Component/s: SQL
    • Labels:

      Description

      Spark SQL is unable to resolve the following query.

          sql(
            """
              |select area, sum(product) over () as c from windowData
              |where product > 3 group by area, product
              |having avg(month) > 0 order by area, avg(month), product
            """.stripMargin)
      

      We need to push down the aggregate functions in Sort into Aggregate.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              smilegator Xiao Li
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: