[TIKA-3993] Improve throttle logic in S3Fetcher

• Type: Task
• Status: Resolved
• Priority: Minor
• Resolution: Fixed
• Fix Version/s: 2.8.0
• Assignee: Unassigned
• Reporter: Tim Allison
• Created: 29/Mar/23 16:57
• Updated: 09/May/23 17:08
• Resolved: 29/Mar/23 18:43

Description

We currently have "tries" and sleep ms amounts. We should allow users to set an array of seconds for backoff to tune their own logarithmic backoff or other strategies. Further, we're retrying all aws exceptions. We should not retry AccessDenied, NoSuchKey etc.

Issue Links

• links to: GitHub Pull Request #1048