[SPARK-43980] Add support for EXCEPT in select clause, similar to what databricks provides

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.4.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Yash Kothari
• Reporter: Yash Kothari
• Created: 06/Jun/23 12:22
• Updated: 23/Nov/23 15:02
• Resolved: 23/Nov/23 15:02

Description

I'm looking for a way to incorporate the select * except(col1, ...) clause provided by Databricks into my workflow. I don't use Databricks and would like to introduce this select except clause either as a spark-package or by contributing a change to Spark.

However, I'm unsure about how to begin this process and would appreciate any guidance from the community.

https://docs.databricks.com/sql/language-manual/sql-ref-syntax-qry-select.html#examples

 

Thank you for your assistance.

Issue Links

• links to: GitHub Pull Request #43843