[HADOOP-9385] create hadoop-common-project/hadoop-filesystem-clients subprojects for blobstore & other clients

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Won't Fix
• Affects Version/s: 3.0.0-alpha1
• Fix Version/s: 3.0.0-alpha1
• Component/s: fs
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 08/Mar/13 14:34
• Updated: 12/May/16 18:27
• Resolved: 31/Oct/15 11:54

Description

As discussed on hadoop-general, we need somewhere to host the non-HDFS filesystem clients. S3/S3N, ftp are all in hadoop-common, with the JAR dependencies there. This doesn't scale to openstack, azure, or handle changes in the S3 dependencies.

With a project of hadoop-common/hadoop-filesystem-clients, we could add separate FS clients: hadoop-filesystem-client-aws, hadoop-filesystem-client-openstack, etc, each with their own tests, JARs and POM file dependencies. This would translate into separate bigtop RPMs/JARs

Issue Links

• relates to: HADOOP-8545 Filesystem Implementation for OpenStack Swift
• supercedes: HADOOP-7601 Move common fs implementations to a hadoop-fs module