Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-7492

If multiple threads call FsVolumeList#checkDirs at the same time, we should only do checkDirs once and give the results to all waiting threads

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • None
    • None
    • datanode
    • None

    Description

      checkDirs is called when we encounter certain I/O errors. It's rare to get just a single I/O error... normally you start getting many errors when a disk is going bad. For this reason, we shouldn't start a new checkDirs scan for each error. Instead, if multiple threads call FsVolumeList#checkDirs at around the same time, we should only do checkDirs once and give the results to all the waiting threads.

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            eclark Elliott Neil Clark
            cmccabe Colin McCabe
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment