Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-28426 Metadata Handling in Thrift Server
  3. SPARK-24570

SparkSQL - show schemas/tables in dropdowns of SQL client tools (ie Squirrel SQL, DBVisualizer.etc)

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.1
    • Fix Version/s: 3.0.0
    • Component/s: SQL
    • Labels:
      None

      Description

      An end-user SQL client tool (ie in the screenshot) can list tables from hiveserver2 and major DBs (Mysql, postgres,oracle, MSSQL..etc). But with SparkSQL it does not display any tables. This would be very convenient for users.

      This is the exception in the client tool (Aqua Data Studio):

      Title: An Error Occurred
      
      Summary: Unable to Enumerate Result
      
      ==================================== Start Message ====================================
      org.apache.spark.sql.catalyst.parser.ParseException: 
      mismatched input '`*`' expecting STRING(line 1, pos 38)
      
      == SQL ==
      SHOW TABLE EXTENDED FROM sit1_pb LIKE `*`
      --------------------------------------^^^
      
      ==================================== End Message ====================================
      
      ==================================== Start Stack Trace ====================================
      java.sql.SQLException: org.apache.spark.sql.catalyst.parser.ParseException: 
      mismatched input '`*`' expecting STRING(line 1, pos 38)
      
      == SQL ==
      SHOW TABLE EXTENDED FROM sit1_pb LIKE `*`
      --------------------------------------^^^
      
      	at org.apache.hive.jdbc.HiveStatement.execute(HiveStatement.java:296)
      	at com.aquafold.aquacore.open.rdbms.drivers.hive.Qꐨꈬꈦꁐ.execute(Unknown Source)
      	at \\.\\.\\हिñçêČάй語简�?한\\.gᚵ᠃᠍ꃰint.execute(Unknown Source)
      	at com.common.ui.tree.hꐊᠱꇗꇐ9int.yW(Unknown Source)
      	at com.common.ui.tree.hꐊᠱꇗꇐ9int$1.process(Unknown Source)
      	at com.common.ui.util.BackgroundThread.run(Unknown Source)
      
      
      ==================================== End Stack Trace ====================================
      

        Attachments

        1. connect-to-sql-db-ssms-locate-table.png
          11 kB
          t oo
        2. hive.png
          84 kB
          t oo
        3. spark.png
          78 kB
          t oo

          Issue Links

            Activity

              People

              • Assignee:
                yumwang Yuming Wang
                Reporter:
                toopt4 t oo
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: