Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16111

FileSystem.closeAllForUGI closes() filesystem in Sync block

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 3.2.0
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      FileSystem.closeAllForUGI() builds the target list and then

      if an FS has many (slow) pending deletes then they all take place in the sync block, which can block other threads. And as the delete calls are serialized, potentially really slow.

      Really we should do more for that delete-on-exit process. IF anyone uses it to any extent, they'll be in trouble.

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated: