[HADOOP-13611] FileSystem/s3a processDeleteOnExit to skip the exists() check

• Type: Sub-task
• Status: Open
• Priority: Trivial
• Resolution: Unresolved
• Affects Version/s: 2.7.3
• Component/s: fs, fs/s3
• Target Version/s: 3.3.0
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 14/Sep/16 13:48
• Updated: 26/Jul/18 17:43

Description

If you look at FileSystem.processDeleteOnExit(), it does an exists() check for each entry, before calling delete().

That exists() check is superfluous; on s3 it add an extra 1-4 HTTP GETs

This could be fixed with a subclass in s3a to avoid it, but as the call is superfluous in all filesystems, it could be removed in FileSystem and so picked up by all object stores.