[HADOOP-12346] Increase some default timeouts / retries for S3a connector

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.7.1
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: fs/s3
• Target Version/s: 2.8.0
• Assignee: Sean Mackrory
• Reporter: Sean Mackrory
• Created: 21/Aug/15 13:30
• Updated: 12/May/16 18:22
• Resolved: 29/Aug/15 17:01

Description

I've been seeing some flakiness in jobs runnings against S3a, both first hand and with other accounts, for which increasing fs.s3a.connection.timeout and fs.s3a.attempts.maximum have been a reliable solution. I propose we increase the defaults.

Issue Links

• is depended upon by: HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance