[HADOOP-13831] Correct check for error code to detect Azure Storage Throttling and provide retries

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.3
• Fix Version/s: 2.9.0, 3.0.0-alpha2
• Component/s: fs/azure
• Target Version/s: 2.9.0
• Hadoop Flags: Reviewed
• Assignee: Gaurav Kanade
• Reporter: Gaurav Kanade
• Created: 23/Nov/16 19:37
• Updated: 15/Dec/16 21:12
• Resolved: 15/Dec/16 20:40

Description

Azure Storage throttling affects HBase operations such as archiving old WALS and others. In such cases the storage driver needs to detect and handle the exception. We put in this logic to do the retries however the condition to check for the exception is not always met due to inconsistency in which the manner the error code is passed back. Instead the retry logic should check for http status code (503) which is more reliable and consistent check