[SPARK-47144] Fix Spark Connect collation issue

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Connect, SQL
• Labels: pull-request-available
• Epic Link: Collation support
• Assignee: Nikola Mandic
• Reporter: Nikola Mandic
• Created: 23/Feb/24 10:17
• Updated: 28/Feb/24 05:07
• Resolved: 28/Feb/24 05:07

Description

Collated expression "SELECT 'abc' COLLATE 'UCS_BASIC_LCASE'" is failing when connecting to sever using Spark Connect:

pyspark.errors.exceptions.connect.SparkConnectGrpcException: (org.apache.spark.sql.connect.common.InvalidPlanInput) Does not support convert string(UCS_BASIC_LCASE) to connect proto types.

When using default collation "UCS_BASIC", the error is not occurring.

Issue Links

• links to: GitHub Pull Request #45233