[HADOOP-16111] FileSystem.closeAllForUGI closes() filesystem in Sync block

• Type: Bug
• Status: Open
• Priority: Minor
• Resolution: Unresolved
• Affects Version/s: 3.2.0
• Assignee: Unassigned
• Reporter: Steve Loughran
• Created: 14/Feb/19 21:50
• Updated: 14/Feb/20 17:32

Description

FileSystem.closeAllForUGI() builds the target list and then

if an FS has many (slow) pending deletes then they all take place in the sync block, which can block other threads. And as the delete calls are serialized, potentially really slow.

Really we should do more for that delete-on-exit process. IF anyone uses it to any extent, they'll be in trouble.

Issue Links

• blocks: HADOOP-16829 Über-jira: S3A Hadoop 3.3.1 features