[HADOOP-17366] hadoop-cloud-storage transient dependencies need review

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 3.4.0
• Fix Version/s: 3.3.5
• Component/s: build, fs, fs/azure
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 09/Nov/20 16:54
• Updated: 03/Mar/23 18:15
• Resolved: 03/Mar/23 18:15

Description

A review of the hadoop cloud storage dependencies shows that things are creeping in there

[INFO] |  +- org.apache.hadoop:hadoop-cloud-storage:jar:3.1.4:compile
[INFO] |  |  +- (org.apache.hadoop:hadoop-annotations:jar:3.1.4:compile - omitted for duplicate)
[INFO] |  |  +- org.apache.hadoop:hadoop-aliyun:jar:3.1.4:compile
[INFO] |  |  |  \- com.aliyun.oss:aliyun-sdk-oss:jar:3.4.1:compile
[INFO] |  |  |     +- org.jdom:jdom:jar:1.1:compile
[INFO] |  |  |     +- org.codehaus.jettison:jettison:jar:1.1:compile
[INFO] |  |  |     |  \- stax:stax-api:jar:1.0.1:compile
[INFO] |  |  |     +- com.aliyun:aliyun-java-sdk-core:jar:3.4.0:compile
[INFO] |  |  |     +- com.aliyun:aliyun-java-sdk-ram:jar:3.0.0:compile
[INFO] |  |  |     +- com.aliyun:aliyun-java-sdk-sts:jar:3.0.0:compile
[INFO] |  |  |     \- com.aliyun:aliyun-java-sdk-ecs:jar:4.2.0:compile
[INFO] |  |  +- (org.apache.hadoop:hadoop-aws:jar:3.1.4:compile - omitted for duplicate)
[INFO] |  |  +- (org.apache.hadoop:hadoop-azure:jar:3.1.4:compile - omitted for duplicate)
[INFO] |  |  +- org.apache.hadoop:hadoop-azure-datalake:jar:3.1.4:compile
[INFO] |  |  |  \- com.microsoft.azure:azure-data-lake-store-sdk:jar:2.2.7:compile
[INFO] |  |  |     \- (org.slf4j:slf4j-api:jar:1.7.21:compile - omitted for conflict with 1.7.30)

Need to review and cut things which come in hadoop-common (slf4j, maybe some of the allyun stuff)

Issue Links

• duplicates: HADOOP-18641 cyclonedx maven plugin breaks builds on recent maven releases (3.9.0)