Details
-
Sub-task
-
Status: Resolved
-
Blocker
-
Resolution: Not A Problem
-
None
-
None
Description
aws v2 sdk dependencies need to
- be in sync with rest of hadoop
- not include anything coming in from hadoop common
- not export in hadoop-cloud-storage stuff from hadoop-common.
currently it is pulling in a version of jackson cbor whose consistency with hadoop's import is simply luck, joda time is also there
In an ideal world all this should be shaded: we cannot have the AWS sdk dictate what jackson version we ship with, given the history of downstream problems there.
[INFO] +- com.amazonaws:aws-java-sdk-core:jar:1.12.316:compile [INFO] | +- software.amazon.ion:ion-java:jar:1.0.2:compile [INFO] | +- com.fasterxml.jackson.dataformat:jackson-dataformat-cbor:jar:2.12.7:compile [INFO] | \- joda-time:joda-time:jar:2.8.1:compile [INFO] +- software.amazon.awssdk:bundle:jar:2.19.12:compile [INFO] | \- software.amazon.eventstream:eventstream:jar:1.0.1:compile [INFO] +- software.amazon.awssdk.crt:aws-crt:jar:0.21.0:compile
Attachments
Issue Links
- is depended upon by
-
HADOOP-18818 Merge aws v2 upgrade feature branch into trunk
-
- Resolved
-
- links to