[HADOOP-14237] S3A Support Shared Instance Profile Credentials Across All Hadoop Nodes

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 2.8.0, 3.0.0-alpha1, 3.0.0-alpha2, 2.8.1
• Component/s: fs/s3

Environment

EC2, AWS

• Assignee: Kazuyuki Tanimura
• Reporter: Kazuyuki Tanimura
• Created: 25/Mar/17 00:35
• Updated: 11/Mar/21 18:16
• Resolved: 11/Mar/21 18:16

Description

When I run a large Hadoop cluster on EC2 instances with IAM Role, it fails getting the instance profile credentials, eventually all jobs on the cluster fail. Since a number of S3A clients (all mappers and reducers) try to get the credentials, the AWS credential endpoint starts responding 5xx and 4xx error codes.

SharedInstanceProfileCredentialsProvider.java is sort of trying to solve it, but it still does not share the credentials with other EC2 nodes / JVM processes.

This issue prevents users from creating Hadoop clusters on EC2

Issue Links

• is related to: HADOOP-14301 Deprecate SharedInstanceProfileCredentialsProvider in branch-2.
• is related to: HADOOP-14248 Retire SharedInstanceProfileCredentialsProvider in trunk.
• relates to: HADOOP-15650 Add custom InstanceProfileCredentialsProvider with more resilience to throttling
• links to: GitHub Pull Request #207
• links to: GitHub Pull Request #207