Affects Version/s: 2.8.0
Fix Version/s: 3.0.0-beta1
Release Note:S3A now defaults to using the "v2" S3 list API, which speeds up large-scale path listings. Non-AWS S3 implementations may not support this API: consult the S3A documentation on how to revert to the v1 API.
Unlike version 1 of the S3 List Objects API, version 2 by default does not fetch object owner information, which S3A doesn't need anyway. By switching to v2, there will be less data to transfer/process. Also, it should be more robust when listing a versioned bucket with "a large number of delete markers" (according to AWS).
Methods in S3AFileSystem that use this API include:
- innerDelete(Path, boolean)
- innerRename(Path, Path)
Requires AWS SDK 1.10.75 or later.