Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23831

Add org.apache.derby to IsolatedClientLoader

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.0
    • Fix Version/s: None
    • Component/s: SQL
    • Labels:
      None

      Description

      Add org.apache.derby to IsolatedClientLoader´╝îotherwise it may throw an exception:

      [info] Cause: java.sql.SQLException: Failed to start database 'metastore_db' with class loader org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see the next exception for details.
      [info] at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
      [info] at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
      [info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
      [info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown Source)
      [info] at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source)
      [info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
      

      How to reproduce:

      build/sbt clean package -Phive -Phive-thriftserver
      export SPARK_PREPEND_CLASSES=true
      bin/spark-sql --conf spark.sql.hive.metastore.version=2.3.4 --conf spark.sql.hive.metastore.jars=maven -e "create table t1 as select 1 as c"
      

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                yumwang Yuming Wang
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: