Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-16111

FileSystem.closeAllForUGI closes() filesystem in Sync block

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 3.2.0
    • None
    • None
    • None

    Description

      FileSystem.closeAllForUGI() builds the target list and then

      if an FS has many (slow) pending deletes then they all take place in the sync block, which can block other threads. And as the delete calls are serialized, potentially really slow.

      Really we should do more for that delete-on-exit process. IF anyone uses it to any extent, they'll be in trouble.

      Attachments

        Issue Links

          Activity

            People

              Unassigned Unassigned
              stevel@apache.org Steve Loughran
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated: