Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Invalid
-
3.0.0
-
None
-
None
Description
Hi,
I am using Databricks cluster with configuration as Spark: 3.0.0 and Scala: 2.12 and want to create Machine Learning pipelines using MLeap - latest version: 0.16.1.
In my pipeline, I have created ensemble model. I am to serialize the model to a bundle.
But the issue comes while deserializing it. Below is the error I am facing:
java.lang.NoSuchMethodError: org.apache.spark.mllib.tree.impurity.ImpurityCalculator$.getCalculator(Ljava/lang/String;[D)Lorg/apache/spark/mllib/tree/impurity/ImpurityCalculator;
I tried using another cluster with the configuration as - spark: 2.4.5, scala: 2.11 and MLeap: 0.16.0. There it is working fine.
Please suggest.