[HADOOP-12269] Update aws-sdk dependency to 1.10.6; move to aws-sdk-s3

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.8.0, 3.0.0-alpha1
• Component/s: fs/s3
• Target Version/s: 2.8.0
• Hadoop Flags: Incompatible change, Reviewed
• Release Note: The Maven dependency on aws-sdk has been changed to aws-sdk-s3 and the version bumped. Applications depending on transitive dependencies pulled in by aws-sdk and not aws-sdk-s3 might not work.
• Assignee: Thomas Demoor
• Reporter: Thomas Demoor
• Created: 24/Jul/15 09:57
• Updated: 19/Jan/19 17:10
• Resolved: 05/Aug/15 01:56

Description

This was originally part of HADOOP-11684, pulling out to this separate subtask as requested by Steve Loughran

Issue Links

• is depended upon by: HADOOP-16055 Upgrade AWS SDK to 1.11.271 in branch-2
• is depended upon by: HADOOP-11694 Über-jira: S3a phase II: robustness, scale and performance
• is depended upon by: HADOOP-12420 While trying to access Amazon S3 through hadoop-aws(Spark basically) I was getting Exception in thread "main" java.lang.NoSuchMethodError: com.amazonaws.services.s3.transfer.TransferManagerConfiguration.setMultipartUploadThreshold(I)V
• is duplicated by: HADOOP-12267 s3a failure due to integer overflow bug in AWS SDK
• is duplicated by: HADOOP-12496 Update AWS SDK version (1.7.4)
• is related to: HADOOP-12496 Update AWS SDK version (1.7.4)
• is required by: HADOOP-11684 S3a to use thread pool that blocks clients
• relates to: SPARK-7481 Add spark-hadoop-cloud module to pull in object store support