[AMBARI-12391] Rolling upgrade failed on Hive restart for Centos 7

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.1.1
• Assignee: Dmitry Lysnichenko
• Reporter: Dmitry Lysnichenko
• Created: 12/Jul/15 17:32
• Updated: 14/Jul/15 15:32
• Resolved: 13/Jul/15 09:58

Description

It's a Metastore restart failure

2015-07-09 18:10:15,641 - Executing Metastore Rolling Upgrade pre-restart
2015-07-09 18:10:15,643 - Upgrading Hive Metastore
2015-07-09 18:10:15,645 - Execute['('cp', '/usr/hdp/current/hive-metastore/lib/mysql-connector-java.jar', u'/usr/hdp/2.3.0.0-2545/hive/lib')'] {'path': ['/bin', '/usr/bin/'], 'sudo': True}
2015-07-09 18:10:15,682 - Execute['/usr/hdp/2.3.0.0-2545/hive/bin/schematool -dbType mysql -upgradeSchema'] {'logoutput': True, 'environment': {'HIVE_CONF_DIR': '/usr/hdp/current/hive-metastore/conf/conf.server'}, 'tries': 1, 'user': 'hive'}
WARNING: Use "yarn jar" to launch YARN applications.
org.apache.hadoop.hive.metastore.HiveMetaException: Failed to load driver
*** schemaTool failed ***

When I tried a dryrun,

sudo -u hive /usr/hdp/2.3.0.0-2545/hive/bin/schematool -dryRun -dbType mysql -upgradeSchema

it doesn't seem to fail on the driver load issue, though it was failing on something else.

I am assuming this is related to us missing some libraries during rolling-upgrades.

But we need to find out what exactly it is that is missing. Is it mysql-connector-java.jar ? Does it need to be readable by hive user, given the ugpradeSchema command above is running as hive?

# ls -l /usr/hdp/2.3.0.0-2545/hive/lib/mysql-connector-java.jar
-rw-r-----. 1 root root 959987 Jul  9 18:10 /usr/hdp/2.3.0.0-2545/hive/lib/mysql-connector-java.jar

Issue Links

• links to: review board