[SPARK-49661] Trim sensitivity support

• Type: New Feature
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Epic Link: Collation support
• Assignee: Jovan Pavlovic
• Reporter: Uroš Bojanić
• Created: 16/Sep/24 13:54
• Updated: 04/Nov/24 11:30
• Resolved: 14/Oct/24 18:35

Issue Links

• links to: GitHub Pull Request #48386

Sub-Tasks

• Implement whitespace trimming for UTF8Strings: Closed
• Put trim sensitivity under a flag: Resolved
• Block trim collations in all code paths: Resolved
• Add trim specifier to collations: Resolved
• Enable suggestions with trim specifiers: Resolved
• Implement collation key support: Resolved
• Implement hash and comparison support: Resolved
• Implement pass-through function support: Resolved
• Implement string function support: Resolved
• Implement regexp funtion support: Open
• Remove the trim sensitivity flag: Open
• Rename StringTypeAnyCollation to reflect all collation identifiers supported: Resolved
• Remove TRIM and RTRIM support: Resolved
• Fix semantic behind "supportsBinaryEquality" in Collation to make it more extendable.: Resolved
• Whitelist rest of the string functions.: Resolved