Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-23473

spark.catalog.listTables error when database name starts with a number

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Trivial
    • Resolution: Invalid
    • 2.1.0
    • None
    • SQL
    • None

    Description

      Errors when Hive database name starts with a number such as 11st. 

      ------------------------------------------------------------------------------------------------------------------------------------  

      scala> spark.catalog.setCurrentDatabase("11st")

      scala> spark.catalog.listTables

      scala> spark.catalog.listTables
      18/02/21 15:47:44 ERROR log: error in initSerDe: java.lang.ClassNotFoundException Class org.apache.hadoop.hive.contrib.serde2.RegexSerDe not found
      java.lang.ClassNotFoundException: Class org.apache.hadoop.hive.contrib.serde2.RegexSerDe not found
      at org.apache.hadoop.conf.Configuration.getClassByName(Configuration.java:2105)
      at org.apache.hadoop.hive.metastore.MetaStoreUtils.getDeserializer(MetaStoreUtils.java:385)
      at org.apache.hadoop.hive.ql.metadata.Table.getDeserializerFromMetaStore(Table.java:276)
      at org.apache.hadoop.hive.ql.metadata.Table.getDeserializer(Table.java:258)
      at org.apache.hadoop.hive.ql.metadata.Table.getCols(Table.java:605)
      at org.apache.spark.sql.hive.client.HiveClientImpl$$anonfun$getTableOption$1$$anonfun$apply$10.apply(HiveClientImpl.scala:365)

      Attachments

        1. spark_catalog_err.txt
          132 kB
          Goun Na

        Activity

          People

            Unassigned Unassigned
            gounna@gmail.com Goun Na
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: