Uploaded image for project: 'Spark'
  1. Spark
  2. SPARK-42919

SELECT * LIKE 'pattern' FROM ....

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.5.0
    • None
    • Spark Core
    • None

    Description

      SparkSQL supports regex_column_names.
      https://spark.apache.org/docs/latest/sql-ref-syntax-qry-select.html
      However, support depends on a config: spark.sql.parser.quotedRegexColumnNames
      The reason is that it overloads proper identifier names.

      Here we propose a cleaner, compatible API:

      SELECT * LIKE 'pattern' ...

      The semantic should follow common regular expression patterns used for the LIKE operator with the caveat that it should obey identifier case insensitivity setting.

      Attachments

        Activity

          People

            Unassigned Unassigned
            srielau Serge Rielau
            Wenchen Fan Wenchen Fan
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: