[HADOOP-17293] S3A to always probe S3 in S3A getFileStatus on non-auth paths

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.1
• Fix Version/s: 3.3.1
• Component/s: fs/s3
• Labels: pull-request-available
• Assignee: Steve Loughran
• Reporter: Steve Loughran
• Created: 02/Oct/20 13:12
• Updated: 09/Oct/20 14:14
• Resolved: 08/Oct/20 14:40

Description

an incidental part of HDP-13230 was a fix to innerGetFileStatus, wherein after a HEAD request we would update the DDB record, so resetting it's TTL

Applications which did remote updates of buckets without going through s3guard are now triggering failures in applications in the cluster when they go to open the file

Issue Links

• is caused by: HADOOP-13230 S3A to optionally retain directory markers
• links to: GitHub Pull Request #2361