[HADOOP-16635] S3A innerGetFileStatus s"directories only" scan still does a HEAD

• Type: Sub-task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.3.0
• Fix Version/s: 3.3.0
• Component/s: fs/s3
• Target Version/s: 3.3.0
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 04/Oct/19 20:14
• Updated: 15/Oct/19 12:53
• Resolved: 14/Oct/19 17:00

Description

The patch in HADOOP-16490 is incomplete: we are still checking for the Head of each object, even though we only wanted the directory checks. As a result, createFile is still vulnerable to 404 caching on unguarded S3 repos.

Issue Links

• contains: HADOOP-16634 S3A ITest failures without S3Guard
• is related to: HADOOP-16634 S3A ITest failures without S3Guard
• links to: GitHub Pull Request #1601