Description
Validate the packaging and dependencies of ABFS
- hadoop-cloud-storage artifact to export everything needed
- hadoop fs -ls abfs://path to work in ASF distributions
- check transient CP (e.g spark)
Spark master;s hadoop-cloud module depends on hadoop-cloud-storage if you build with the hadoop-3.1 profile, so it should automatically get in there. Just need to check that it picks it up too