[SPARK-1406] PMML model evaluation support via MLib

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 1.4.0
• Component/s: MLlib
• Target Version/s: 1.4.0
• Assignee: Vincenzo Selvaggio
• Reporter: Thomas Darimont
• Created: 03/Apr/14 11:33
• Updated: 06/Jul/15 18:58
• Resolved: 30/Apr/15 06:21

Description

It would be useful if spark would provide support the evaluation of PMML models (http://www.dmg.org/v4-2/GeneralStructure.html).

This would allow to use analytical models that were created with a statistical modeling tool like R, SAS, SPSS, etc. with Spark (MLib) which would perform the actual model evaluation for a given input tuple. The PMML model would then just contain the "parameterization" of an analytical model.

Other projects like JPMML-Evaluator do a similar thing.
https://github.com/jpmml/jpmml/tree/master/pmml-evaluator

Issue Links

• relates to: SPARK-7540 PMML correctness check
• relates to: SPARK-4587 Model export/import
• relates to: SPARK-8545 PMML improvement umbrella
• links to: [Github] Pull Request #3062 (selvinsource)