Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-16458

SessionCatalog should support `listColumns` for temporary tables

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: SQL
    • Labels:
      None

      Description

      Temporary tables are used frequently, but `spark.catalog.listColumns` does not support those tables.

      scala> spark.range(10).createOrReplaceTempView("t1")
      
      scala> spark.catalog.listTables().collect()
      res1: Array[org.apache.spark.sql.catalog.Table] = Array(Table[name='t1', tableType='TEMPORARY', isTemporary='true'])
      
      scala> spark.catalog.listColumns("t1").collect()
      org.apache.spark.sql.AnalysisException: Table 't1' does not exist in database 'default'.;
      

      This issue make `SessionCatalog` supports temporary table column listing.

        Attachments

        Issue Links

          Activity

            People

            • Assignee:
              dongjoon Dongjoon Hyun
              Reporter:
              dongjoon Dongjoon Hyun

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment