Uploaded image for project: 'CarbonData'
  1. CarbonData
  2. CARBONDATA-2444

使用carbondata1.3.1的问题

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 1.3.1
    • None
    • spark-integration
    • None
    • cloudera manager 5.10.2 ,CDH 5.10.2 Spark升级为2.2.0,hadoop是CDH的2.6.0,carbondata是1.3.1,使用carbondata 1.3.0能正常使用。
    • Hide
      To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel).
      Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.util.Utils$.getUserJars(Lorg/apache/spark/SparkConf;Z)Lscala/collection/Seq;
              at org.apache.spark.repl.Main$.doMain(Main.scala:59)
              at org.apache.spark.repl.Main$.main(Main.scala:53)
              at org.apache.spark.repl.Main.main(Main.scala)
              at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
              at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
              at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
              at java.lang.reflect.Method.invoke(Method.java:498)
              at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:775)
              at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)
              at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205)
              at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119)
              at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)
      Show
      To adjust logging level use sc.setLogLevel(newLevel). For SparkR, use setLogLevel(newLevel). Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.util.Utils$.getUserJars(Lorg/apache/spark/SparkConf;Z)Lscala/collection/Seq;         at org.apache.spark.repl.Main$.doMain(Main.scala:59)         at org.apache.spark.repl.Main$.main(Main.scala:53)         at org.apache.spark.repl.Main.main(Main.scala)         at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)         at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)         at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)         at java.lang.reflect.Method.invoke(Method.java:498)         at org.apache.spark.deploy.SparkSubmit$.org$apache$spark$deploy$SparkSubmit$$runMain(SparkSubmit.scala:775)         at org.apache.spark.deploy.SparkSubmit$.doRunMain$1(SparkSubmit.scala:180)         at org.apache.spark.deploy.SparkSubmit$.submit(SparkSubmit.scala:205)         at org.apache.spark.deploy.SparkSubmit$.main(SparkSubmit.scala:119)         at org.apache.spark.deploy.SparkSubmit.main(SparkSubmit.scala)

    Description

      环境CDH5.10.2 对用的组件,使用carbondata时报错(注:spark已经升级为2.2.0,hadoop为2.6.0CDH)

      Exception in thread "main" java.lang.NoSuchMethodError: org.apache.spark.util.Utils$.getUserJars(Lorg/apache/spark/SparkConf;Z)Lscala/collection/Seq;

      Attachments

        Activity

          People

            Unassigned Unassigned
            niaoshu niaoshu
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: