Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28426 Metadata Handling in Thrift Server
  3. SPARK-24570

SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.1
    • 3.0.0
    • SQL
    • None

    Description

      An end-user SQL client tool (ie in the screenshot) can list tables from hiveserver2 and major DBs (Mysql, postgres,oracle, MSSQL..etc). But with SparkSQL it does not display any tables. This would be very convenient for users.

      This is the exception in the client tool (Aqua Data Studio):

      Title: An Error Occurred
      
      Summary: Unable to Enumerate Result
      
      ==================================== Start Message ====================================
      org.apache.spark.sql.catalyst.parser.ParseException: 
      mismatched input '`*`' expecting STRING(line 1, pos 38)
      
      == SQL ==
      SHOW TABLE EXTENDED FROM sit1_pb LIKE `*`
      --------------------------------------^^^
      
      ==================================== End Message ====================================
      
      ==================================== Start Stack Trace ====================================
      java.sql.SQLException: org.apache.spark.sql.catalyst.parser.ParseException: 
      mismatched input '`*`' expecting STRING(line 1, pos 38)
      
      == SQL ==
      SHOW TABLE EXTENDED FROM sit1_pb LIKE `*`
      --------------------------------------^^^
      
      	at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:296)
      	at com.aquafold.aquacore.open.rdbms.drivers.hive.Qꐨꈬꈦꁐ.execute(Unknown Source)
      	at \\.\\.\\हिñçêČάй語简�?한\\.gᚵ᠃᠍ꃰint.execute(Unknown Source)
      	at com.common.ui.tree.hꐊᠱꇗꇐ9int.yW(Unknown Source)
      	at com.common.ui.tree.hꐊᠱꇗꇐ9int$1.process(Unknown Source)
      	at com.common.ui.util.BackgroundThread.run(Unknown Source)
      
      
      ==================================== End Stack Trace ====================================
      

      Attachments

        1. connect-to-sql-db-ssms-locate-table.png
          11 kB
          t oo
        2. hive.png
          84 kB
          t oo
        3. spark.png
          78 kB
          t oo

        Issue Links

          Activity

            People

              yumwang Yuming Wang
              toopt4 t oo
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: