[SPARK-9122] spark.mllib regression should support batch predict

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.5.0
• Component/s: MLlib, PySpark
• Labels: starter
• Target Version/s: 1.5.0
• Assignee: Yanbo Liang
• Reporter: Joseph K. Bradley
• Shepherd: Joseph K. Bradley
• Created: 16/Jul/15 23:25
• Updated: 31/Jul/15 01:19
• Resolved: 24/Jul/15 01:53

Description

Currently, in spark.mllib, generalized linear regression models like LinearRegressionModel, RidgeRegressionModel and LassoModel support predict() via: LinearRegressionModelBase.predict, which only takes single rows (feature vectors).

It should support batch prediction, taking an RDD. (See other classes which do this already such as NaiveBayesModel.)

Issue Links

• Is contained by: SPARK-7536 Audit MLlib Python API for 1.4
• Is contained by: SPARK-5981 pyspark ML models should support predict/transform on vector within map
• links to: [Github] Pull Request #7614 (yanboliang)