Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-49501

Catalog createTable API is double-escaping paths

    XMLWordPrintableJSON

Details

    Description

      Creating an external table using spark.catalog.createTable results in incorrect escaping of special chars in paths.

      Consider the following code:

      {{spark.catalog.createTable("testTable", source = "parquet", schema = new StructType().add("id", "int"), description = "", options = Map("path" -> "/tmp/test table"))}}

      The above call creates a table that is stored in /tmp/test%20table instead of /tmp/test table. Note that this behaviour is different from the SQL API, e.g. create table testTable(id int) using parquet location '/tmp/test table'

      Attachments

        Issue Links

          Activity

            People

              cstavr Christos Stavrakakis
              cstavr Christos Stavrakakis
              Wenchen Fan Wenchen Fan
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: