Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-4366 Aggregation Improvement
  3. SPARK-9422

Remove the placeholder attributes used in the aggregation buffers

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.5.0
    • SQL
    • None

    Description

      Originally, to merge two aggregation buffers, we create a mutable buffer with extra placeholder attributes to represent grouping expressions (because the input aggregation buffer has grouping keys). This was done to make the first implementation easy. We can remove it now, which can also help us to implement the hash aggregate operator using unsafe row as the buffer.

      Attachments

        Activity

          People

            yhuai Yin Huai
            yhuai Yin Huai
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: