Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11086

DataNode disk check improvements

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Done
    • None
    • None
    • datanode
    • None

    Description

      This Jira tracks a few improvements to DataNode’s usage of DiskChecker to address the following problems:

      1. Checks are serialized so a single slow disk can indefinitely delay checking the rest.
      2. Related to 1, no detection of stalled checks.
      3. Lack of granularity. A single IO error initiates checking all disks.
      4. Inconsistent activation. Some DataNode IO failures trigger disk checks but not all.

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            arp Arpit Agarwal
            arp Arpit Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment