[DRILL-8342] Add Automatic Retry for Rate Limited APIs

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.20.2
• Fix Version/s: 1.21.0
• Component/s: Storage - HTTP
• Assignee: Charles Givre
• Reporter: Charles Givre
• Created: 23/Oct/22 00:58
• Updated: 02/Nov/22 09:00
• Resolved: 02/Nov/22 09:00

Description

Many APIs have a burst limit for number of requests.  This PR adds a retry capability to the HTTP Storage Plugin, whereby if a 429 response code is received, Drill will wait a configurable amount of time, and retry the request once. 

To prevent runaway pagination, this retry will only happen once per request. 

This PR adds a new configuration option called retryDelay which is the number of milliseconds that Drill should wait between retrys.