[SPARK-26247] SPIP - ML Model Extension for no-Spark MLLib Online Serving

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Incomplete
• Affects Version/s: 2.1.0
• Component/s: MLlib
• Labels: SPIP bulk-closed
• Assignee: Unassigned
• Reporter: Anne Holler
• Shepherd: Felix Cheung
• Created: 02/Dec/18 21:45
• Updated: 21/Jun/21 11:26
• Resolved: 25/May/21 01:39

Description

This ticket tracks an SPIP to improve model load time and model serving interfaces for online serving of Spark MLlib models.  The SPIP is here

https://docs.google.com/a/uber.com/document/d/e/2PACX-1vRttVNNMBt4pBU2oBWKoiK3-7PW6RDwvHNgSMqO67ilxTX_WUStJ2ysUdAk5Im08eyHvlpcfq1g-DLF/pub

 

The improvement opportunity exists in all versions of spark.  We developed our set of changes wrt version 2.1.0 and can port them forward to other versions (e.g., we have ported them forward to 2.3.2).