[HADOOP-13687] Provide a unified dependency artifact that transitively includes the cloud storage modules shipped with Hadoop.

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.9.0, 3.0.0-alpha2
• Component/s: build
• Target Version/s: 2.9.0, 3.0.0-alpha2
• Hadoop Flags: Reviewed
• Assignee: Chris Nauroth
• Reporter: Chris Nauroth
• Created: 05/Oct/16 20:08
• Updated: 10/Nov/16 17:20
• Resolved: 10/Nov/16 17:06

Description

Currently, downstream projects that want to integrate with different Hadoop-compatible file systems like WASB and S3A need to list dependencies on each one. This creates an ongoing maintenance burden for those projects, because they need to update their build whenever a new Hadoop-compatible file system is introduced. This issue proposes adding a new artifact that transitively includes all Hadoop-compatible file systems. Similar to hadoop-client, this new artifact will consist of just a pom.xml listing the individual dependencies. Downstream users can depend on this artifact to sweep in everything, and picking up a new file system in a future version will be just a matter of updating the Hadoop dependency version.

Issue Links

• relates to: HADOOP-13037 Refactor Azure Data Lake Store as an independent FileSystem