Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-41355

Workaround hive table name validation issue

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.4.0
    • 3.4.0
    • SQL
    • None

    Description

      For example:

      • We want to create a table called tAb_I
      • Hive metastore will check if the table name is valid by MetaStoreUtils.validateName(tbl.getTableName())
      • Hive will call HiveStringUtils.normalizeIdentifier(tbl.getTableName()) and then save the save the table name to lower case, but after setting the local to "tr", it will be tab_ı which is not a valid table name
      • When we run alter table command, we will first get the hive table from hive metastore which is not a valid table name.
      • Update some properties or other, and then try to save it to hive metastore.
      • Hive metastore will check if the table name is valid and then throw exception org.apache.hadoop.hive.ql.metadata.HiveException: [tab_ı]: is not a valid table name

      Attachments

        Activity

          People

            wankun Wan Kun
            wankun Wan Kun
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: