[SPARK-15799] Release SparkR on CRAN

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.1.2
• Component/s: SparkR
• Assignee: Shivaram Venkataraman
• Reporter: Xiangrui Meng
• Shepherd: Shivaram Venkataraman
• Created: 07/Jun/16 06:48
• Updated: 12/Dec/22 18:11
• Resolved: 12/Oct/17 16:52

Description

Story: "As an R user, I would like to see SparkR released on CRAN, so I can use SparkR easily in an existing R environment and have other packages built on top of SparkR."

I made this JIRA with the following questions in mind:

• Are there known issues that prevent us releasing SparkR on CRAN?
• Do we want to package Spark jars in the SparkR release?
• Are there license issues?
• How does it fit into Spark's release process?

Sub-Tasks

• Add CRAN checks to SparkR: Resolved
• Fix documentation warnings found by R CMD check: Resolved
• Rename window.partitionBy and window.orderBy: Resolved
• Move SparkR test JAR into Spark, include its source code: Resolved
• Handle SparkR RDD generics that create warnings in R CMD check: Resolved
• Add check-cran script to Jenkins: Resolved
• Add a spark install function: Resolved
• Making JVM backend calling functions public: Resolved
• Build and package R vignettes: Resolved
• Ensure nothing is written outside R's tempdir() by default: Resolved
• CRAN tests do not run with SparkR source package: Resolved
• Skip SparkR tests when missing Hadoop winutils on CRAN windows machines: Resolved
• Shorten test sets to run on CRAN: Resolved
• SparkR vignette fails on CRAN on Java 11: Resolved
• SparkR tests failed on CRAN on Java 10: Resolved
• Fix java version parsing in SparkR on Windows: Resolved
• Prevent R CMD check from using /tmp: Resolved
• disable R vignettes code on Windows: Resolved