[SPARK-7924] Consolidate example code in MLlib

• Type: Umbrella
• Status: Resolved
• Priority: Major
• Resolution: Done
• Component/s: Documentation, ML, MLlib
• Assignee: Xiangrui Meng
• Reporter: Xiangrui Meng
• Created: 28/May/15 21:30
• Updated: 05/May/18 03:14
• Resolved: 05/May/18 03:14

Description

This JIRA is an umbrella for consolidating example code in MLlib, now that we are able to insert code snippets from examples into the user guide. This will contain tasks not already handled by SPARK-11337.

Goal: Have all example code in the examples/ folder, and insert code snippets for examples into the user guide. This will make the example code easily testable and reduce duplication.

We will have 1 subtask per example. If you would like to help, please either create a subtask or comment below asking us to create a subtask for you.

For an example to follow, look at:

• https://github.com/apache/spark/blob/0171b71e9511cef512e96a759e407207037f3c49/examples/src/main/scala/org/apache/spark/examples/ml/TfIdfExample.scala
• TF-IDF example in https://raw.githubusercontent.com/apache/spark/0171b71e9511cef512e96a759e407207037f3c49/docs/ml-features.md

Issue Links

• contains: SPARK-11381 Replace example code in mllib-linear-methods.md using include_example
• is related to: SPARK-11685 Find duplicate content under examples/
• is related to: SPARK-11337 Make example code in user guide testable
• relates to: SPARK-10383 Sync example code between API doc and user guide