[HADOOP-17244] HADOOP-17244. S3A directory delete tombstones dir markers prematurely.

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.3.1
• Fix Version/s: 3.3.1
• Component/s: fs/s3
• Labels: pull-request-available
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 04/Sep/20 18:07
• Updated: 30/Nov/20 18:28
• Resolved: 18/Nov/20 13:28

Description

Test failure: ITestS3AFileContextMainOperations#testRenameDirectoryAsNonExistentDirectory

This is repeatable on -Dauth runs (we haven't been running them, have we?)

Either its from the recent dir marker changes (initial hypothesis) or its been lurking a while and not been picked up.

Issue Links

• breaks: HADOOP-17403 S3A ITestPartialRenamesDeletes.testRenameDirFailsInDelete failure: missing directory marker
• is caused by: HADOOP-13230 S3A to optionally retain directory markers
• relates to: HADOOP-16430 S3AFilesystem.delete to incrementally update s3guard with deletions
• links to: GitHub Pull Request #2280
• links to: GitHub Pull Request #2310