[SPARK-11000] Derby have booted the database twice in yarn security mode.

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.6.0
• Fix Version/s: 1.6.0
• Component/s: Spark Shell, SQL, YARN
• Assignee: Zhaowei Huang
• Reporter: Zhaowei Huang
• Created: 08/Oct/15 06:12
• Updated: 17/Oct/15 23:42
• Resolved: 17/Oct/15 23:42

Description

bin/spark-shell --master yarn-client
If spark was build with hive, this simple command will also have a problem: Another instance of Derby may have already booted the database

Exeception

Caused by: java.sql.SQLException: Another instance of Derby may have already booted the database /opt/client/Spark/spark/metastore_db.
        at org.apache.derby.impl.jdbc.SQLExceptionFactory.getSQLException(Unknown Source)
        at org.apache.derby.impl.jdbc.SQLExceptionFactory40.wrapArgsForTransportAcrossDRDA(Unknown Source)
        at org.apache.derby.impl.jdbc.SQLExceptionFactory40.getSQLException(Unknown Source)
        at org.apache.derby.impl.jdbc.Util.generateCsSQLException(Unknown Source)
        ... 130 more
Caused by: ERROR XSDB6: Another instance of Derby may have already booted the database /opt/client/Spark/spark/metastore_db.

Issue Links

• relates to: SPARK-9776 Another instance of Derby may have already booted the database
• links to: [Github] Pull Request #9026 (SaintBacchus)