[HADOOP-16956] Tencent Cloud COS: Package it into hadoop-dist

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 3.3.0, 3.3.1
• Component/s: fs/cos
• Assignee: Yang Yu
• Reporter: Yang Yu
• Created: 03/Apr/20 09:30
• Updated: 09/Apr/20 14:08

Description

[e-mail]  Hi, Steve, the Hadoop-COS has been submitted to the trunk branch last year. (Related jira: https://issues.apache.org/jira/browse/HADOOP-15616). 

I am the contributor and the maintainer of this patch.  Considering that you are the expert on the object storage support in Hadoop, I have some questions for you.

1. The Hadoop-cos patch is placed in the hadoop-cloud-storage-project directory. How to package it into the hadoop-dist directory as the distribution package?
2. How to manage the dependencies of the Hadoop-cos, such as cos-java-sdk? I use the maven to compile and package it, but only the hadoop-cos-3.4.0-SNAPSHOT.jar is generated. I compare the pom.xml between the hadoop-cos and hadoop-oss, and find the dependency scope is 'compile' in their pom.xml. The hadoop-oss has oss-java-sdk.jar in dist directory, but the hadoop-cos does not. 

Can you guide me how to solve these two problems? 

 

Thanks for your time and attention.