Our supported Hadoop releases all need to handle s3a stores where the s3a client does not delete directory markers.
This is only the minimal set of list changes; no intent of changing marker retention policy. It should be transparent to all clients
- list/getFileStatus changes
- backwards compatible test of new algorithm
- new tests to verify marker handling
- marker rename bug (
HADOOP-17200) surfacing in testing