[SPARK-37508] Add CONTAINS() function

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: SQL
• Labels: pull-request-available
• Epic Link: New functions in Spark SQL 3.3
• Assignee: angerszhu
• Reporter: Max Gekk
• Shepherd: Max Gekk
• Created: 30/Nov/21 14:02
• Updated: 19/Jan/24 00:19
• Resolved: 01/Dec/21 09:57

Description

contains() is a common convenient function supported by a number of database systems:

1. https://cloud.google.com/bigquery/docs/reference/standard-sql/functions-and-operators#contains_substr
2. https://docs.snowflake.com/en/_static/apple-touch-icon.png!CONTAINS — Snowflake Documentation

Proposed syntax:

contains(haystack, needle)
return type: boolean 

It is semantically equivalent to haystack like '%needle%'

Issue Links

• is related to: SPARK-37582 Support the binary type by contains()
• links to: [Github] Pull Request #34761 (AngersZhuuuu)
• links to: [Github] Pull Request #34786 (AngersZhuuuu)
• links to: [Github] Pull Request #34786 (AngersZhuuuu)
• links to: GitHub Pull Request #43089