[SPARK-41780] `regexp_replace('', '[a\\\\d]{0, 2}', 'x')` causes an internal error

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.4.0
• Component/s: SQL

Environment

Spark3.3.0 local mode

• Assignee: BingKun Pan
• Reporter: Remzi Yang
• Created: 30/Dec/22 03:15
• Updated: 09/Jan/23 08:38
• Resolved: 09/Jan/23 08:38

Description

scala> spark.sql("select regexp_replace('', '[a\\\\d]{0,2}', 'x')").show
+----------------------------------+
|regexp_replace(, [a\d]\{0,2}, x, 1)|
+----------------------------------+
|                                 x|
+----------------------------------+
 
 
scala> spark.sql("select regexp_replace('', '[a\\\\d]{0, 2}', 'x')").show
org.apache.spark.SparkException: The Spark SQL phase optimization failed with an internal error. Please, fill a bug report in, and provide the full stack trace.

 

Issue Links

• links to: [Github] Pull Request #39383 (panbingkun)