Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-31121 catalog plugin API
  3. SPARK-24252

DataSourceV2: Add catalog support

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 2.3.0
    • 3.0.0
    • SQL

    Description

      DataSourceV2 needs to support create and drop catalog operations in order to support logical plans like CTAS.

      Attachments

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-25186 Stabilize Data Source V2 API

          • Major - Major loss of function.
          • In Progress
          relates to

          Bug - A problem which impairs or prevents the functions of the product. SPARK-25006 Add optional catalog to TableIdentifier

          • Major - Major loss of function.
          • Resolved
          supercedes

          Improvement - An improvement or enhancement to an existing feature or task. SPARK-30617 Is there any possible that spark no longer restrict enumerate types of spark.sql.catalogImplementation

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed
          links to

          Web Link GitHub Pull Request #21306

          Web Link GitHub Pull Request #23915

          Web Link GitHub Pull Request #24246

          Web Link GitHub Pull Request #24410

          Web Link SPIP: Spark Catalog APIs

          Activity

            People

              rdblue Ryan Blue
              rdblue Ryan Blue
              Votes:
              1 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: