Uploaded image for project: 'Mahout'
  1. Mahout
  2. MAHOUT-1889

Mahout doesn't work with Spark 2.0

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Duplicate
    • Affects Version/s: None
    • Fix Version/s: 0.14.0
    • Component/s: None
    • Labels:
      None

      Description

      In Spark 2.0 was changes path to libraries and classpath. If change classpath to correct for Spark 2.0, all Spark job failed with java.lang.NoSuchMethodError: , because Spark API was changed.

      Example for spark-shell:

      ./bin/mahout spark-shell
      
      Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.repl.SparkILoop.setPrompt(Ljava/lang/String;)V
      	at org.apache.mahout.sparkbindings.shell.MahoutSparkILoop.<init>(MahoutSparkILoop.scala:58)
      	at org.apache.mahout.sparkbindings.shell.Main$.main(Main.scala:32)
      	at org.apache.mahout.sparkbindings.shell.Main.main(Main.scala)
      
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                vaifer Sergey Svynarchuk
              • Votes:
                1 Vote for this issue
                Watchers:
                6 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: