[SPARK-45851] (Scala) Support different retry policies for connect client

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 4.0.0
• Fix Version/s: 4.0.0
• Component/s: Connect
• Labels: pull-request-available
• Assignee: Alice Sayutina
• Reporter: Alice Sayutina
• Created: 09/Nov/23 10:50
• Updated: 16/Nov/23 10:42
• Resolved: 16/Nov/23 10:42

Description

Support multiple retry policies defined at the same time. Each policy determines which error types it can retry and how exactly.

For instance, networking errors should generally be retried differently that
remote resource being available.

Relevant python ticket: SPARK-45733

Issue Links

• links to: GitHub Pull Request #43757