Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-22488

The view resolution in the SparkSession internal table() API

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.1.2, 2.2.0
    • 2.2.1, 2.3.0
    • SQL
    • None

    Description

      The current internal `table()` API of `SparkSession` bypasses the Analyzer and directly calls `sessionState.catalog.lookupRelation` API. This skips the view resolution logics in our Analyzer rule `ResolveRelations`. This internal API is widely used by various DDL commands or the other internal APIs.

      Users might get the strange error caused by view resolution when the default database is different.
      ```
      Table or view not found: t1; line 1 pos 14
      org.apache.spark.sql.AnalysisException: Table or view not found: t1; line 1 pos 14
      at org.apache.spark.sql.catalyst.analysis.package$AnalysisErrorAt.failAnalysis(package.scala:42)
      ```

      Attachments

        Activity

          People

            smilegator Xiao Li
            smilegator Xiao Li
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: