[SPARK-48263] Collate function support for non UTF8_BINARY strings

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Epic Link: Collation support
• Assignee: Nebojsa Savic
• Reporter: Nebojsa Savic
• Created: 13/May/24 16:21
• Updated: 14/May/24 15:39
• Resolved: 14/May/24 15:39

Description

When default collation level config is set to some collation other than UTF8_BINARY (i.e. UTF8_BINARY_LCASE) and when we try to execute COLLATE (or collation) expression, this will fail because it is only accepting StringType(0) as argument for collation name.

Issue Links

• links to: GitHub Pull Request #46574