[HADOOP-14483] increase default value of fs.s3a.multipart.size to 128M

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 2.8.0
• Component/s: fs/s3
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 02/Jun/17 19:36
• Updated: 29/Aug/18 17:22
• Resolved: 29/Aug/18 17:22

Description

increment the default value of fs.s3a.multipart.size from "100M" to "128M".

Why? AWS S3 throttles clients making too many requests; going to a larger size will reduce this. Also: document the issue