[HADOOP-14301] Deprecate SharedInstanceProfileCredentialsProvider in branch-2.

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0
• Component/s: fs/s3
• Target Version/s: 2.9.0
• Hadoop Flags: Reviewed

Release Note

SharedInstanceProfileCredentialsProvider has been deprecated. Users should use InstanceProfileCredentialsProvider provided by AWS SDK instead, which itself enforces a singleton instance to reduce calls to AWS EC2 Instance Metadata Service. SharedInstanceProfileCredentialsProvider will be removed permanently in a future release.

• Assignee: Mingliang Liu
• Reporter: Mingliang Liu
• Created: 12/Apr/17 16:58
• Updated: 12/Apr/17 18:08
• Resolved: 12/Apr/17 17:12

Description

HADOOP-13727 added the SharedInstanceProfileCredentialsProvider, which effectively reduces high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider. That patch, in order to prevent the throttling problem, defined new class SharedInstanceProfileCredentialsProvider as a subclass of InstanceProfileCredentialsProvider, which enforces creation of only a single instance.

Per HADOOP-13050, we upgraded the AWS Java SDK. Since then, the InstanceProfileCredentialsProvider in SDK code internally enforces a singleton. SharedInstanceProfileCredentialsProvider can be deprecated as of release 2.9.0.

Issue Links

• relates to: HADOOP-13050 Upgrade to AWS SDK 1.11.45
• relates to: HADOOP-13727 S3A: Reduce high number of connections to EC2 Instance Metadata Service caused by InstanceProfileCredentialsProvider.
• relates to: HADOOP-14237 S3A Support Shared Instance Profile Credentials Across All Hadoop Nodes
• relates to: HADOOP-14248 Retire SharedInstanceProfileCredentialsProvider in trunk.