[SPARK-30923] Spark MLlib, GraphX 3.0 QA umbrella

• Type: Umbrella
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.0.0
• Component/s: Documentation, GraphX, ML, MLlib, PySpark
• Assignee: Unassigned
• Reporter: Xiao Li
• Created: 22/Feb/20 04:03
• Updated: 26/Mar/20 03:13
• Resolved: 26/Mar/20 03:13

Description

Description
This JIRA lists tasks for the next Spark release's QA period for MLlib and GraphX. *SparkR is separate.

The list below gives an overview of what is involved, and the corresponding JIRA issues are linked below that.

API

• Check binary API compatibility for Scala/Java
• Audit new public APIs (from the generated html doc)
  • Scala
  • Java compatibility
  • Python coverage
• Check Experimental, DeveloperApi tags

Algorithms and performance

• Performance tests

Documentation and example code

• For new algorithms, create JIRAs for updating the user guide sections & examples
• Update Programming Guide
• Update website

Sub-Tasks

• ML, GraphX 3.0 QA: API: Binary incompatible changes: Resolved
• ML, GraphX 3.0 QA: API: New Scala APIs, docs: Resolved
• ML, GraphX 3.0 QA: API: Experimental, DeveloperApi, final, sealed audit: Resolved
• ML 3.0 QA: API: Python API coverage: Resolved
• ML 3.0 QA: API: Java compatibility, docs: Resolved
• ML, GraphX 3.0 QA: Update user guide for new features & APIs: Resolved
• ML, GraphX 3.0 QA: Programming guide update and migration guide: Resolved
• Update MLlib, GraphX websites for 3.0: Resolved