[SPARK-4047] Generate runtime warning for naive implementation examples for algorithms implemented in MLlib/graphx

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Affects Version/s: 1.1.0
• Fix Version/s: 1.2.0
• Component/s: Examples
• Labels: easyfix newbie
• Assignee: Varadharajan
• Reporter: Varadharajan
• Created: 22/Oct/14 15:45
• Updated: 10/Nov/14 22:34
• Resolved: 10/Nov/14 22:34

Description

Based on SPARK-2434, we're generating runtime warnings to denote that the example implementation of algorithms were naive and a well implemented version is available in MLlib. Here are list of examples that are related to algorithms implemented in MLlib and graphx.

1. LocalALS
2. LocalFileLR
3. LocalKMeans
4. LocalLR
5. SparkALS
6. SparkHdfsLR
7. SparkKMeans
8. SparkLR
9. SparkPageRank
10. SparkTachyonHdfsLR

Python examples:

1. ALS
2. kmeans
3. logistic_regression
4. pagerank

Java examples:

1. JavaHdfsLR
2. JavaPageRank

- Examples with missing runtime warnings.

Also in few examples implementing LR, its currently pointing to org.apache.spark.mllib.classification.LogisticRegression instead of org.apache.spark.mllib.classification.LogisticRegressionModel

Issue Links

• links to: [Github] Pull Request #2894 (varadharajan)