Uploaded image for project: 'Kylin'
  1. Kylin
  2. KYLIN-4922

Failed to build cube

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Not A Bug
    • v4.0.0-beta
    • v4.0.0-beta
    • Spark Engine
    • kylin v4.0-beta、CDH-6.3.1、Spark version CDH-2.4.0,

    Description

      Error Log:

      java.io.IOException: OS command error exit with return code: 1, error message: WARNING: User-defined SPARK_HOME (/opt/cloudera/parcels/CDH-6.3.1-1.cdh6.3.1.p0.1470567/lib/spark) overrides detected (/opt/cloudera/parcels/CDH/lib/spark).
      WARNING: Running spark-class from user-defined location.
      Exception in thread "main" org.apache.spark.SparkException: Cluster deploy mode is not compatible with master "local"
      at org.apache.spark.deploy.SparkSubmit.error(SparkSubmit.scala:859)
      at org.apache.spark.deploy.SparkSubmit.prepareSubmitEnvironment(SparkSubmit.scala:290)
      at org.apache.spark.deploy.SparkSubmit.submit(SparkSubmit.scala:143)
      at org.apache.spark.deploy.SparkSubmit.doSubmit(SparkSubmit.scala:86)
      at org.apache.spark.deploy.SparkSubmit$$anon$2.doSubmit(SparkSubmit.scala:926)
      at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:935)
      at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      The command is:
      export HADOOP_CONF_DIR=/opt/kylin/hadoop_conf && /opt/cloudera/parcels/CDH/lib/spark/bin/spark-submit --class org.apache.kylin.engine.spark.application.SparkEntry --conf 'spark.yarn.queue=default' --conf 'spark.history.fs.logDirectory=hdfs:///kylin/spark-history' --conf 'spark.master=local' --conf 'spark.hadoop.yarn.timeline-service.enabled=false' --conf 'spark.driver.cores=1' --conf  

      Attachments

        1. error.png
          43 kB
          YANG LIU
        2. server config.png
          28 kB
          YANG LIU

        Activity

          People

            Unassigned Unassigned
            YANG LIU YANG LIU
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: