[SPARK-6817] DataFrame UDFs in R

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Done
• Component/s: SparkR
• Target Version/s: 2.0.0
• External issue URL: https://sparkr.atlassian.net/browse/SPARKR-231
• Assignee: Unassigned
• Reporter: Shivaram Venkataraman
• Created: 09/Apr/15 20:49
• Updated: 18/Jun/16 10:18
• Resolved: 18/Jun/16 10:18

Description

This depends on some internal interface of Spark SQL, should be done after merging into Spark.

Issue Links

• relates to: SPARK-10053 SparkR isn't exporting lapply
• relates to: SPARK-12918 Support R SQL UDF in SparkR

Sub-Tasks

• Refactor RRDD to support R UDF: Resolved
• Support R UDF Evaluation: Closed
• Support Defining and Registration of R UDF: Closed
• Implement dapply() on DataFrame in SparkR: Resolved
• Implement gapply() on DataFrame in SparkR: Resolved
• Add a wrapper for dapply(repartition(col,...), ... ): Closed
• add dapplyCollect() method for DataFrame in SparkR: Resolved