Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-18932

Partial aggregation for collect_set / collect_list

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.2.0
    • SQL, Structured Streaming
    • None

    Description

      The lack of partial aggregation here is blocking us from using these in streaming. It still won't be fast, but it would be nice to at least be able to use them.

      Attachments

        Activity

          People

            viirya L. C. Hsieh
            marmbrus Michael Armbrust
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: