[HADOOP-10373] create tools/hadoop-amazon for aws/EMR support

• Type: Improvement
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0
• Fix Version/s: 2.6.0
• Component/s: fs/s3
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 27/Feb/14 09:40
• Updated: 24/Dec/14 02:27
• Resolved: 11/Sep/14 18:47

Description

After HADOOP-9565 adds a marker interface for blobstores, move s3 & s3n into their own hadoop-amazon library

1. keeps the S3 dependencies out of the standard hadoop client dependency graph.
2. lets people switch this for alternative implementations.

feature #2 would let you swap over to another s3n impl (e.g. amazon's) without rebuilding everything

Issue Links

• is depended upon by: HADOOP-10400 Incorporate new S3A FileSystem implementation
• relates to: HADOOP-11444 Jets3tFileSystemStore fails to remove initial slash from object keys, resulting in objects with double forward slashes being stored

Sub-Tasks

• Move s3-related FS connector code to hadoop-aws: Closed