Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26247

SPIP - ML Model Extension for no-Spark MLLib Online Serving

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.1.0
    • Fix Version/s: None
    • Component/s: MLlib
    • Labels:

      Description

      This ticket tracks an SPIP to improve model load time and model serving interfaces for online serving of Spark MLlib models.  The SPIP is here

      https://docs.google.com/a/uber.com/document/d/e/2PACX-1vRttVNNMBt4pBU2oBWKoiK3-7PW6RDwvHNgSMqO67ilxTX_WUStJ2ysUdAk5Im08eyHvlpcfq1g-DLF/pub

       

      The improvement opportunity exists in all versions of spark.  We developed our set of changes wrt version 2.1.0 and can port them forward to other versions (e.g., we have ported them forward to 2.3.2).

        Attachments

        1. diff.scoreInstance
          63 kB
          Anne Holler
        2. diff.reduceLoadLatency
          19 kB
          Anne Holler
        3. diff.out
          81 kB
          Anne Holler
        4. SPIPMlModelExtensionForOnlineServing.pdf
          169 kB
          Anne Holler

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              aholler Anne Holler
              Shepherd:
              Felix Cheung
            • Votes:
              5 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

              • Created:
                Updated: