[HADOOP-16473] S3Guard prune to only remove auth dir marker if files (not tombstones) are removed

• Type: Sub-task
• Status: Resolved
• Priority: Minor
• Resolution: Won't Fix
• Affects Version/s: 3.2.0
• Component/s: fs/s3
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 30/Jul/19 16:05
• Updated: 27/Feb/21 11:11
• Resolved: 27/Feb/21 11:11

Description

the s3guard prune command marks all dirs as non-auth if an entry was deleted. This makes sense from a performance perspective. But if only tombstones are being purged, it doesn't -all it does is hurt the performance of future scans