Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-470

NoSuchMethodError: scala.Predef ... with defining SPARK_HOME

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 0.5.5
    • None
    • Interpreters
    • None
    • CentOS 6.5
      JDK 1.7.0_75
      Maven 3.3.9
      Hadoop 2.6.2
      Spark 1.5.2
      Zeppelin 0.5.5

    Description

      It's standalone environment (1 Linux Box).
      The Hadoop, Spark and Zeppelin are built from source and the building command for Zeppelin is:
      mvn clean package -Pspark-1.5 -Dhadoop.version=2.6.2 -Phadoop-2.6 -Pyarn -Ppyspark -DskipTests

      The zeppelin-env.sh file that defined SPARK_HOME as the Spark installed directory.

      When ran the 'sc.version' in the Notebook,
      The log/zeppelin-xxx.out file shows the error messages as follows:
      ...
      Exception in thread "main" java.lang.NoSuchMethodError: scala.Predef$.$conforms()Lscala/Predef$$less$colon$less;
      at org.apache.spark.util.Utils$.getDefaultPropertiesFile(Utils.scala:1838)
      at org.apache.spark.deploy.SparkSubmitArguments$$anonfun$mergeDefaultSparkProperties$1.apply(SparkSubmitArguments.scala:117)
      ...

      Any ideas of how can be fixed? Any help will be appreciated.

      Thanks.

      For reference:
      I also tried to use embedded spark binaries setting but not working:
      https://issues.apache.org/jira/browse/ZEPPELIN-471

      Attachments

        Activity

          People

            Unassigned Unassigned
            kevintsai Kevin Tsai
            Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

              Created:
              Updated: