[SPARK-49207] Fix SplitPart one-to-many case mapping (UTF8_LCASE)

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Uroš Bojanić
• Reporter: Uroš Bojanić
• Created: 12/Aug/24 07:44
• Updated: 13/Aug/24 15:45
• Resolved: 13/Aug/24 15:45

Description

Fix the following string expressions to handle one-to-many case mapping properly:

• SplitPart
• StringSplitSQL

 

Examples of incorrect results (under UTF8_LCASE collation):

SplitPart("Ai\u0307B", "İ", 2) // returns: "\u0307B" (incorrect), instead of: "B" (correct)
SplitPart("AİB", "i\u0307", 1) // returns: "AİB", instead of: "A", "B" (correct)

 

StringSplitSQL("Ai\u0307B", "İ") // returns: ["A", "\u0307B"] (incorrect), instead of: ["A", "B"] (correct)
StringSplitSQL("AİB", "i\u0307") // returns: ["AİB"] (incorrect), instead of: ["A", "B"] (correct)

Issue Links

• links to: GitHub Pull Request #47715