[HIVE-24393] Connecting Spark SQL to Hive Metastore (with Remote Metastore Server)

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.3.3
• Component/s: Configuration
• Target Version/s: storage-2.7.1
• Assignee: Unassigned
• Reporter: Mani
• Due: 18/Nov/20
• Created: 16/Nov/20 21:55
• Updated: 21/Oct/22 07:20

Description

HI There,

I'm working on Integrating  Apache big data solution on SAP HANA DB,

 

I successfully installed the following versions on Linux OS.

JAVA	openjdk version "1.8.0_232
Hadoop	apache hadoop-2.7.1

HIVE	apache-hive-1.2.1
Derby	apache  db-derby-10.12.1.1
Spark	Apache spark-2.3.2

 

currently, i, having an issue to access hive meta store using spark-submit.

getting the below error.

spark.catalog.listTables.show

20/11/17 08:53:58 INFO HiveUtils: Initializing HiveMetastoreConnection version 1.2.1 using file:/home/spark/spark-2.3.2/lib/*.jar
java.lang.ClassNotFoundException: java.lang.NoClassDefFoundError: org/apache/hadoop/hive/conf/HiveConf when creating Hive client using classpath: file:/home/spark/spark-2.3.2/lib/*.jar
Please make sure that jars for your version of hive and hadoop are included in the paths passed to spark.sql.hive.metastore.jars

 

please help us 

Regards,
Mani