Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-39422

SHOW CREATE TABLE should suggest 'AS SERDE' for Hive tables with unsupported serde configurations

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0
    • 3.2.2, 3.3.1
    • SQL
    • None

    Description

      If you run `SHOW CREATE TABLE` against a Hive table which uses an unsupported Serde configuration, Spark will return an error message like

      org.apache.spark.sql.AnalysisException: Failed to execute SHOW CREATE TABLE against table rcFileTable, which is created by Hive and uses the following unsupported serde configuration
       SERDE: org.apache.hadoop.hive.serde2.columnar.LazyBinaryColumnarSerDe INPUTFORMAT: org.apache.hadoop.hive.ql.io.RCFileInputFormat OUTPUTFORMAT: org.apache.hadoop.hive.ql.io.RCFileOutputFormat 

      which is confusing to end users.

      In this situation, I think the error should suggest `SHOW CREATE TABLE ... AS SERDE` to users (similar to other error messages in this code path).

      Attachments

        Activity

          People

            joshrosen Josh Rosen
            joshrosen Josh Rosen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: