[SPARK-5483] java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Not A Problem
• Affects Version/s: 1.2.0
• Component/s: MLlib

Environment

Maven
Spark 1.2

• Assignee: Unassigned
• Reporter: DeepakVohra
• Created: 29/Jan/15 15:19
• Updated: 31/Jan/15 16:54
• Resolved: 30/Jan/15 16:48

Description

Naive Bayes classifier generates following error.

ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)
java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
at breeze.generic.MMRegistry2$class.register(Multimethod.scala:188)
at breeze.linalg.VectorOps$$anon$1.breeze$linalg$operators$BinaryRegistry$$super$register(Vector.scala:303)
at breeze.linalg.operators.BinaryRegistry$class.register(BinaryOp.scala:87)
at breeze.linalg.VectorOps$$anon$1.register(Vector.scala:303)
at breeze.linalg.operators.DenseVectorOps$$anon$1.<init>(DenseVectorOps.scala:38)
at breeze.linalg.operators.DenseVectorOps$class.$init$(DenseVectorOps.scala:22)
at breeze.linalg.DenseVector$.<init>(DenseVector.scala:225)
at breeze.linalg.DenseVector$.<clinit>(DenseVector.scala)
at breeze.linalg.DenseVector.<init>(DenseVector.scala:63)
at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:50)
at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:55)
at org.apache.spark.mllib.linalg.DenseVector.toBreeze(Vectors.scala:329)
at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:112)
at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:110)
at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:200)
at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:199)
at org.apache.spark.util.collection.AppendOnlyMap.changeValue(AppendOnlyMap.scala:142)
at org.apache.spark.util.collection.SizeTrackingAppendOnlyMap.changeValue(SizeTrackingAppendOnlyMap.scala:32)
at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:205)
at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:58)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
at org.apache.spark.scheduler.Task.run(Task.scala:56)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:196)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)
15/01/28 21:50:06 ERROR SparkUncaughtExceptionHandler: Uncaught exception in thread Thread[Executor task launch worker-0,5,main]
java.lang.NoSuchMethodError: scala.Predef$.ArrowAssoc(Ljava/lang/Object;)Ljava/lang/Object;
at breeze.generic.MMRegistry2$class.register(Multimethod.scala:188)
at breeze.linalg.VectorOps$$anon$1.breeze$linalg$operators$BinaryRegistry$$super$register(Vector.scala:303)
at breeze.linalg.operators.BinaryRegistry$class.register(BinaryOp.scala:87)
at breeze.linalg.VectorOps$$anon$1.register(Vector.scala:303)
at breeze.linalg.operators.DenseVectorOps$$anon$1.<init>(DenseVectorOps.scala:38)
at breeze.linalg.operators.DenseVectorOps$class.$init$(DenseVectorOps.scala:22)
at breeze.linalg.DenseVector$.<init>(DenseVector.scala:225)
at breeze.linalg.DenseVector$.<clinit>(DenseVector.scala)
at breeze.linalg.DenseVector.<init>(DenseVector.scala:63)
at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:50)
at breeze.linalg.DenseVector$mcD$sp.<init>(DenseVector.scala:55)
at org.apache.spark.mllib.linalg.DenseVector.toBreeze(Vectors.scala:329)
at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:112)
at org.apache.spark.mllib.classification.NaiveBayes$$anonfun$3.apply(NaiveBayes.scala:110)
at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:200)
at org.apache.spark.util.collection.ExternalSorter$$anonfun$5.apply(ExternalSorter.scala:199)
at org.apache.spark.util.collection.AppendOnlyMap.changeValue(AppendOnlyMap.scala:142)
at org.apache.spark.util.collection.SizeTrackingAppendOnlyMap.changeValue(SizeTrackingAppendOnlyMap.scala:32)
at org.apache.spark.util.collection.ExternalSorter.insertAll(ExternalSorter.scala:205)
at org.apache.spark.shuffle.sort.SortShuffleWriter.write(SortShuffleWriter.scala:58)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:68)
at org.apache.spark.scheduler.ShuffleMapTask.runTask(ShuffleMapTask.scala:41)
at org.apache.spark.scheduler.Task.run(Task.scala:56)
at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:196)
at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
at java.lang.Thread.run(Thread.java:745)

Issue Links

• is duplicated by: SPARK-5489 KMeans clustering java.lang.NoSuchMethodError: scala.runtime.IntRef.create (I)Lscala/runtime/IntRef;