[HADOOP-13611] FileSystem/s3a processDeleteOnExit to skip the exists() check

• Type: Sub-task
• Status: Open
• Priority: Trivial
• Resolution: Unresolved
• Affects Version/s: 2.7.3
• Component/s: fs, fs/s3
• Target Version/s: 3.5.0
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 14/Sep/16 13:48
• Updated: 04/Jan/24 11:54

Description

If you look at FileSystem.processDeleteOnExit(), it does an exists() check for each entry, before calling delete().

That exists() check is superfluous; on s3 it add an extra 1-4 HTTP GETs

This could be fixed with a subclass in s3a to avoid it, but as the call is superfluous in all filesystems, it could be removed in FileSystem and so picked up by all object stores.

Issue Links

• is duplicated by: HADOOP-16877 S3A FS deleteOnExit to skip the exists check
• is related to: HADOOP-18340 deleteOnExit does not work with S3AFileSystem
• links to: #1924