Details

    • Type: Bug
    • Status: Resolved
    • Priority: Critical
    • Resolution: Fixed
    • Affects Version/s: 2.0.1
    • Fix Version/s: 2.0.2, 2.1.0
    • Component/s: SQL
    • Labels:
    • Environment:

      apache hadoop 2.6.2
      spark 2.0.1

      Description

      After deploy spark thrift server on YARN, then I tried to execute from the beeline following command.
      > show databases;
      I've got this error message.

      beeline> !connect jdbc:hive2://localhost:10000 a a
      Connecting to jdbc:hive2://localhost:10000
      16/10/19 22:50:18 INFO Utils: Supplied authorities: localhost:10000
      16/10/19 22:50:18 INFO Utils: Resolved authority: localhost:10000
      16/10/19 22:50:18 INFO HiveConnection: Will try to open client transport with JDBC Uri: jdbc:hive2://localhost:10000
      Connected to: Spark SQL (version 2.0.1)
      Driver: Hive JDBC (version 1.2.1.spark2)
      Transaction isolation: TRANSACTION_REPEATABLE_READ
      0: jdbc:hive2://localhost:10000> show databases;
      java.lang.IllegalStateException: Can't overwrite cause with java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GenericInternalRow cannot be cast to org.apache.spark.sql.catalyst.expressions.UnsafeRow
      at java.lang.Throwable.initCause(Throwable.java:456)
      at org.apache.hive.service.cli.HiveSQLException.toStackTrace(HiveSQLException.java:236)
      at org.apache.hive.service.cli.HiveSQLException.toStackTrace(HiveSQLException.java:236)
      at org.apache.hive.service.cli.HiveSQLException.toCause(HiveSQLException.java:197)
      at org.apache.hive.service.cli.HiveSQLException.<init>(HiveSQLException.java:108)
      at org.apache.hive.jdbc.Utils.verifySuccess(Utils.java:256)
      at org.apache.hive.jdbc.Utils.verifySuccessWithInfo(Utils.java:242)
      at org.apache.hive.jdbc.HiveQueryResultSet.next(HiveQueryResultSet.java:365)
      at org.apache.hive.beeline.BufferedRows.<init>(BufferedRows.java:42)
      at org.apache.hive.beeline.BeeLine.print(BeeLine.java:1794)
      at org.apache.hive.beeline.Commands.execute(Commands.java:860)
      at org.apache.hive.beeline.Commands.sql(Commands.java:713)
      at org.apache.hive.beeline.BeeLine.dispatch(BeeLine.java:973)
      at org.apache.hive.beeline.BeeLine.execute(BeeLine.java:813)
      at org.apache.hive.beeline.BeeLine.begin(BeeLine.java:771)
      at org.apache.hive.beeline.BeeLine.mainWithInputRedirection(BeeLine.java:484)
      at org.apache.hive.beeline.BeeLine.main(BeeLine.java:467)
      Caused by: org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 669.0 failed 4 times, most recent failure: Lost task 0.3 in stage 669.0 (TID 3519, edw-014-22): java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GenericInternalRow cannot be cast to org.apache.spark.sql.catalyst.expressions.UnsafeRow
      at org.apache.spark.sql.execution.SparkPlan$$anonfun$4.apply(SparkPlan.scala:247)
      at org.apache.spark.sql.execution.SparkPlan$$anonfun$4.apply(SparkPlan.scala:240)
      at org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$24.apply(RDD.scala:803)
      at org.apache.spark.rdd.RDD$$anonfun$mapPartitionsInternal$1$$anonfun$apply$24.apply(RDD.scala:803)
      at org.apache.spark.rdd.MapPartitionsRDD.compute(MapPartitionsRDD.scala:38)
      at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:319)
      at org.apache.spark.rdd.RDD.iterator(RDD.scala:283)
      at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:70)
      at org.apache.spark.scheduler.Task.run(Task.scala:86)
      at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:274)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:745)

      Driver stacktrace:
      at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
      at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      at java.lang.reflect.Constructor.newInstance(Constructor.java:526)
      at org.apache.hive.service.cli.HiveSQLException.newInstance(HiveSQLException.java:244)
      at org.apache.hive.service.cli.HiveSQLException.toStackTrace(HiveSQLException.java:210)
      ... 15 more
      Error: Error retrieving next row (state=,code=0)

      "add jar" command also same error occurred.

      add jar ~/udf.jar
      java.lang.IllegalStateException: Can’t overwrite cause with java.lang.ClassCastException: org.apache.spark.sql.catalyst.expressions.GenericInternalRow cannot be cast to org.apache.spark.sql.catalyst.expressions.UnsafeRow
      at java.lang.Throwable.initCause (Throwable.java:456)

        Attachments

          Activity

            People

            • Assignee:
              dkbiswal Dilip Biswal
              Reporter:
              jerryjung Jerryjung
            • Votes:
              1 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: