Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-26247

SPIP - ML Model Extension for no-Spark MLLib Online Serving

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Incomplete
    • 2.1.0
    • None
    • MLlib

    Description

      This ticket tracks an SPIP to improve model load time and model serving interfaces for online serving of Spark MLlib models.  The SPIP is here

      https://docs.google.com/a/uber.com/document/d/e/2PACX-1vRttVNNMBt4pBU2oBWKoiK3-7PW6RDwvHNgSMqO67ilxTX_WUStJ2ysUdAk5Im08eyHvlpcfq1g-DLF/pub

       

      The improvement opportunity exists in all versions of spark.  We developed our set of changes wrt version 2.1.0 and can port them forward to other versions (e.g., we have ported them forward to 2.3.2).

      Attachments

        1. diff.out
          81 kB
          Anne Holler
        2. diff.reduceLoadLatency
          19 kB
          Anne Holler
        3. diff.scoreInstance
          63 kB
          Anne Holler
        4. SPIPMlModelExtensionForOnlineServing.pdf
          169 kB
          Anne Holler

        Activity

          People

            Unassigned Unassigned
            aholler Anne Holler
            Felix Cheung Felix Cheung
            Votes:
            5 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: