[SPARK-11600] Spark MLlib 1.6 QA umbrella

• Type: Umbrella
• Status: Resolved
• Priority: Critical
• Resolution: Done
• Fix Version/s: 1.6.0
• Component/s: Documentation, ML, MLlib
• Assignee: Joseph K. Bradley
• Reporter: Joseph K. Bradley
• Created: 09/Nov/15 20:30
• Updated: 21/Apr/16 19:34
• Resolved: 29/Dec/15 09:19

Description

This JIRA lists tasks for the next MLlib release's QA period.

API

• Check binary API compatibility (SPARK-11601)
• Audit new public APIs (from the generated html doc)
  • Scala (SPARK-11602)
  • Java compatibility (SPARK-11605)
  • Python coverage (SPARK-11604)
• Check Experimental, DeveloperApi tags (SPARK-11603)

Algorithms and performance

Performance

• List any other missing performance tests from spark-perf here
• ALS.recommendAll (SPARK-7457)
• perf-tests in Python (SPARK-7539)
• perf-tests for transformers (SPARK-2838)
• MultilayerPerceptron (SPARK-11911)

Documentation and example code

• For new algorithms, create JIRAs for updating the user guide (SPARK-11606)
• For major components, create JIRAs for example code (SPARK-9670)
• Update Programming Guide for 1.6 (towards end of QA) (SPARK-11608)
• Update website (SPARK-11607)
• Merge duplicate content under examples/ (SPARK-11685)

Issue Links

• is cloned by: SPARK-14808 Spark MLlib, GraphX, SparkR 2.0 QA umbrella
• is related to: SPARK-9568 Spark MLlib 1.5.0 testing umbrella

Sub-Tasks

• Examples: Check for new APIs requiring example code: Resolved
• ML 1.6 QA: API: Binary incompatible changes: Closed
• ML 1.6 QA: API: New Scala APIs, docs: Resolved
• ML 1.6 QA: API: Experimental, DeveloperApi, final, sealed audit: Resolved
• ML 1.6 QA: API: Python API coverage: Resolved
• ML 1.6 QA: API: Java compatibility, docs: Resolved
• ML 1.6 QA: Update user guide for new APIs: Resolved
• Update MLlib website for 1.6: Resolved
• ML 1.6 QA: Programming guide update and migration guide: Resolved