[SPARK-47200] Handle and classify errors from ForEachBatchSink user function

• Type: Task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Structured Streaming
• Labels: pull-request-available
• Assignee: B. Micheal Okutubo
• Reporter: B. Micheal Okutubo
• Created: 28/Feb/24 01:40
• Updated: 10/Mar/24 23:45
• Resolved: 29/Feb/24 22:37

Description

Any exception can be thrown from the user provided function for ForEachBatchSink. We want to classify this class of errors. Including errors from Python and Scala functions.

Issue Links

• links to: GitHub Pull Request #45299
• links to: GitHub Pull Request #45449