[SPARK-23105] Spark MLlib, GraphX 2.3 QA umbrella

• Type: Umbrella
• Status: Resolved
• Priority: Critical
• Resolution: Resolved
• Fix Version/s: 2.3.0
• Component/s: Documentation, GraphX, ML, MLlib
• Target Version/s: 2.3.0
• Assignee: Joseph K. Bradley
• Reporter: Joseph K. Bradley
• Created: 17/Jan/18 00:33
• Updated: 20/Sep/18 16:14
• Resolved: 01/Feb/18 09:27

Description

This JIRA lists tasks for the next Spark release's QA period for MLlib and GraphX. SparkR is separate: SPARK-23114.

The list below gives an overview of what is involved, and the corresponding JIRA issues are linked below that.

API

• Check binary API compatibility for Scala/Java
• Audit new public APIs (from the generated html doc)
  • Scala
  • Java compatibility
  • Python coverage
• Check Experimental, DeveloperApi tags

Algorithms and performance

• Performance tests

Documentation and example code

• For new algorithms, create JIRAs for updating the user guide sections & examples
• Update Programming Guide
• Update website

Issue Links

• is a clone of: SPARK-20499 Spark MLlib, GraphX 2.2 QA umbrella
• is related to: SPARK-23114 Spark R 2.3 QA umbrella

Sub-Tasks

• ML, Graph 2.3 QA: API: Binary incompatible changes: Resolved
• ML, Graph 2.3 QA: API: New Scala APIs, docs: Resolved
• ML, Graph 2.3 QA: API: Experimental, DeveloperApi, final, sealed audit: Resolved
• ML 2.3 QA: API: Python API coverage: Resolved
• ML 2.3 QA: API: Java compatibility, docs: Resolved
• ML, Graph 2.3 QA: Update user guide for new features & APIs: Resolved
• ML, Graph 2.3 QA: Programming guide update and migration guide: Resolved
• Update MLlib, GraphX websites for 2.3: Resolved