[HADOOP-9680] Extend S3FS and S3NativeFS to work with AWS IAM Temporary Security Credentials

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 2.1.0-beta, 3.0.0-alpha1
• Component/s: fs/s3
• Assignee: Unassigned
• Reporter: Robert Gibbon
• Created: 01/Jul/13 10:13
• Updated: 07/Nov/16 18:10
• Resolved: 07/Nov/16 18:10

Description

Here is a patch in unified diff format to enable Amazon Web Services IAM Temporary Security Credentials secured interactions with S3 from Hadoop.

It bumps the JetS3t release version up to 0.9.0.

To use a temporary security credential set, you need to provide the following properties, depending on the implementation (s3 or s3native):

fs.s3.awsAccessKeyId or fs.s3n.awsAccessKeyId - the temporary access key id issued by AWS IAM
fs.s3.awsSecretAccessKey or fs.s3n.awsSecretAccessKey - the temporary secret access key issued by AWS IAM
fs.s3.awsSessionToken or fs.s3n.awsSessionToken - the session ticket issued by AWS IAM along with the temporary key
fs.s3.awsTokenFriendlyName or fs.s3n.awsTokenFriendlyName - any string

Issue Links

• is related to: HADOOP-10400 Incorporate new S3A FileSystem implementation
• relates to: HADOOP-12537 S3A to support Amazon STS temporary credentials