[SPARK-49902] RegExpReplace does not catch runtime errors when it fails on certain rows

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: SQL
• Labels: pull-request-available
• Assignee: Harsh Motwani
• Reporter: Harsh Motwani
• Created: 08/Oct/24 01:47
• Updated: 23/Oct/24 10:02
• Resolved: 23/Oct/24 10:02

Description

Currently, RegExprReplace does not catch any exceptions during runtime. It lets the underlying Java libraries throw whichever error they do. It would be good if Spark caught the underlying exceptions and threw a formal SparkException.

Issue Links

• links to: GitHub Pull Request #48379