[SPARK-5489] KMeans clustering java.lang.NoSuchMethodError: scala.runtime.IntRef.create (I)Lscala/runtime/IntRef;

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 1.2.0
• Component/s: MLlib

Environment

Spark 1.2
Maven

• Assignee: Unassigned
• Reporter: DeepakVohra
• Created: 29/Jan/15 23:19
• Updated: 30/Jan/15 18:24
• Resolved: 30/Jan/15 13:00

Description

The KMeans clustering generates following error, which also seems to be due version mismatch between Scala used for compiling Spark and Scala in Spark 1.2 Maven dependency.

Exception in thread "main" java.lang.NoSuchMethodError: scala.runtime.IntRef.create

(I)Lscala/runtime/IntRef;
at

org.apache.spark.mllib.clustering.KMeans.initKMeansParallel(KMeans.scala:282)
at

org.apache.spark.mllib.clustering.KMeans.runAlgorithm(KMeans.scala:155)
at

org.apache.spark.mllib.clustering.KMeans.run(KMeans.scala:132)
at

org.apache.spark.mllib.clustering.KMeans$.train(KMeans.scala:352)
at

org.apache.spark.mllib.clustering.KMeans$.train(KMeans.scala:362)
at

org.apache.spark.mllib.clustering.KMeans.train(KMeans.scala)
at

clusterer.kmeans.KMeansClusterer.main(KMeansClusterer.java:35)

Issue Links

• duplicates: SPARK-5483 java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;