[HIVE-21639] Spark test failed since HIVE-10632

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.3.5, 2.4.0
• Assignee: Yuming Wang
• Reporter: Yuming Wang
• Created: 21/Apr/19 16:48
• Updated: 12/Dec/22 18:11
• Resolved: 25/Apr/19 16:42

Description

We hint the following exception when upgrading Spark‘s built-in Hive to 2.3.4:

..
[info] Cause: java.sql.SQLException: Failed to start database 'metastore_db' with class loader org.apache.spark.sql.hive.client.IsolatedClientLoader$$anon$1@2439ab23, see the next exception for details.
[info] at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.Util.seeNextException(Unknown Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.bootDatabase(Unknown Source)
[info] at org.apache.derby.impl.jdbc.EmbedConnection.<init>(Unknown Source)
[info] at org.apache.derby.jdbc.InternalDriver$1.run(Unknown Source)
...

This issue Introduced by HIVE-10632 and fixed by HIVE-17561, I'd like to backport part of HIVE-17561 to fix this issue for branch-2.

Issue Links

• blocks: SPARK-23831 Add org.apache.derby to IsolatedClientLoader
• causes: BIGTOP-3304 Fix build failure of Flume against hive-2.3.6
• links to: HIVE-21639