Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-24393

Connecting Spark SQL to Hive Metastore (with Remote Metastore Server)

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.3.3
    • Fix Version/s: storage-2.7.1
    • Component/s: Configuration
    • Labels:
      None

      Description

      HI There,

      I'm working on Integrating  Apache big data solution on SAP HANA DB,

       

      I successfully installed the following versions on Linux OS.

      JAVA openjdk version "1.8.0_232
      Hadoop apache hadoop-2.7.1
      HIVE apache-hive-1.2.1
      Derby apache  db-derby-10.12.1.1
      Spark Apache spark-2.3.2

       

      currently, i, having an issue to access hive meta store using spark-submit.

      getting the below error.

      spark.catalog.listTables.show

      20/11/17 08:53:58 INFO HiveUtils: Initializing HiveMetastoreConnection version 1.2.1 using file:/home/spark/spark-2.3.2/lib/*.jar
      java.lang.ClassNotFoundException: java.lang.NoClassDefFoundError: org/apache/hadoop/hive/conf/HiveConf when creating Hive client using classpath: file:/home/spark/spark-2.3.2/lib/*.jar
      Please make sure that jars for your version of hive and hadoop are included in the paths passed to spark.sql.hive.metastore.jars

       

      please help us 

      Regards,
      Mani

       

       

       

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Mandadim Mani
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Due:
                Created:
                Updated:

                Time Tracking

                Estimated:
                Original Estimate - 48h
                48h
                Remaining:
                Remaining Estimate - 48h
                48h
                Logged:
                Time Spent - Not Specified
                Not Specified