Uploaded image for project: 'Zeppelin'
  1. Zeppelin
  2. ZEPPELIN-471

Could not find creator property with name ... with embedded spark binaries

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 0.5.5
    • Fix Version/s: None
    • Component/s: Interpreters
    • Labels:
      None
    • Environment:

      CentOS 6.5
      JDK 1.7.0_75
      Maven 3.3.9
      Hadoop 2.6.2
      Spark 1.5.2
      Zeppelin 0.5.5

      Description

      It's standalone environment (1 Linux Box).
      The Hadoop, Spark and Zeppelin are built from source and the building command for Zeppelin is:
      mvn clean package -Pspark-1.5 -Dhadoop.version=2.6.2 -Phadoop-2.6 -Pyarn -Ppyspark -DskipTests

      And setup the zeppelin-env.sh file to use embedded spark binaries.
      (Just added one line to let SPARK_HOME be empty from the default conf file settings)

      When ran the 'sc.version' in the Notebook that it works fine.
      but when ran the code as follows it will fail:
      ```
      %spark
      val data = Array(1, 2, 3, 4, 5)
      val distData = sc.parallelize(data)
      ```

      and the error messages are:
      com.fasterxml.jackson.databind.JsonMappingException: Could not find creator property with name 'id' (in class org.apache.spark.rdd.RDDOperationScope) at [Source:

      {"id":"0","name":"parallelize"}

      ; line: 1, column: 1] at com.fasterxml.jackson.databind.JsonMappingException.from(JsonMappingException.java:148) at com.fasterxml.jackson.databind.DeserializationContext.mappingException(DeserializationContext.java:843)

      Any ideas of how can be fixed? Any help will be appreciated.

      Thanks.

      For reference:
      I also tried to use provided spark installtion setting but not working:
      https://issues.apache.org/jira/browse/ZEPPELIN-470

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              kevintsai Kevin Tsai
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: