[SPARK-14808] Spark MLlib, GraphX, SparkR 2.0 QA umbrella

• Type: Umbrella
• Status: Resolved
• Priority: Critical
• Resolution: Done
• Fix Version/s: 2.0.0
• Component/s: Documentation, GraphX, ML, MLlib, SparkR
• Target Version/s: 2.0.0
• Assignee: Joseph K. Bradley
• Reporter: Joseph K. Bradley
• Created: 21/Apr/16 19:34
• Updated: 07/Nov/16 19:13
• Resolved: 19/Jul/16 20:26

Description

This JIRA lists tasks for the next Spark release's QA period for MLlib, GraphX, and SparkR.

The list below gives an overview of what is involved, and the corresponding JIRA issues are linked below that.

API

• Check binary API compatibility for Scala/Java
• Audit new public APIs (from the generated html doc)
  • Scala
  • Java compatibility
  • Python coverage
  • R
• Check Experimental, DeveloperApi tags

Algorithms and performance

Performance

• List any other missing performance tests from spark-perf here
• perf-tests for transformers (SPARK-2838)
• MultilayerPerceptron (SPARK-11911)

Documentation and example code

• For new algorithms, create JIRAs for updating the user guide sections & examples
• Update Programming Guide
• Update website

Issue Links

• is a clone of: SPARK-11600 Spark MLlib 1.6 QA umbrella
• is cloned by: SPARK-18316 Spark MLlib, GraphX 2.1 QA umbrella

Sub-Tasks

• ML, Graph 2.0 QA: API: Binary incompatible changes: Resolved
• ML, Graph 2.0 QA: API: New Scala APIs, docs: Resolved
• ML, Graph 2.0 QA: API: Experimental, DeveloperApi, final, sealed audit: Resolved
• ML 2.0 QA: API: Python API coverage: Resolved
• ML 2.0 QA: API: Java compatibility, docs: Resolved
• ML, Graph, R 2.0 QA: Update user guide for new features & APIs: Resolved
• Update MLlib, GraphX, SparkR websites for 2.0: Resolved
• ML, Graph, R 2.0 QA: Programming guide update and migration guide: Resolved
• R Examples: Check for new R APIs requiring example code in 2.0: Resolved
• R 2.0 QA: New R APIs and API docs: Resolved
• R programming guide update: Resolved
• Additional fixes to Mllib 2.0 documentation: Resolved