Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-554

Add aggregateByKey

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: None
    • Labels:
      None

      Description

      Similar to the new fold() and aggregate() methods in #95, we should have foldByKey and aggregateByKey for pair RDDs. The main thing that makes this slightly harder is that we'll have to change the combineByKey API and ShuffledRDD to allow taking in a "zero value".

        Attachments

          Activity

            People

            • Assignee:
              sandyr Sandy Ryza
              Reporter:
              matei Matei Alexandru Zaharia
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: