[HADOOP-13211] Swift driver should have a configurable retry feature when ecounter 5xx error

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 2.7.2
• Component/s: fs/swift
• Assignee: Unassigned
• Reporter: Chen He
• Created: 27/May/16 04:55
• Updated: 21/Jul/16 05:14

Description

In current code. if Swift driver meets a HTTP 5xx, it will throw exception and stop. As a driver, it will be more sophisticate if it can retry a configurable times before report failure. There are two reasons that I can image:

1. if the server is really busy, it is possible that the server will drop some requests to avoid DDoS attack.

2. If server accidentally unavailable for a short period of time and come back again, we may not need to fail the whole driver. Just record the exception and retry may be more flexible.