Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-15944 Make spark.ml package backward compatible with spark.mllib vectors
  3. SPARK-16000

Make model loading backward compatible with saved models using old vector columns

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.1.0
    • ML, MLlib
    • None

    Description

      To help users migrate from Spark 1.6. to 2.0, we should make model loading backward compatible with models saved in 1.6. The main incompatibility is the vector column type change.

      Attachments

        Issue Links

          contains

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16133 model loading backward compatibility for ml.feature

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16240 model loading backward compatibility for ml.clustering.LDA

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16130 model loading backward compatibility for ml.classfication.LogisticRegression

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16132 model loading backward compatibility for tree model (DecisionTree, RF, GBT)

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16177 model loading backward compatibility for ml.regression

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16241 model loading backward compatibility for ml NaiveBayes

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16243 model loading backward compatibility for ml.feature.PCA

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16245 model loading backward compatibility for ml.feature.PCA

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-16176 model loading backward compatibility for ml.recommendation

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-15573 Backwards-compatible persistence for spark.ml

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              yuhaoyan yuhao yang
              mengxr Xiangrui Meng
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: