Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11086

DataNode disk check improvements

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Done
    • None
    • None
    • datanode
    • None

    Description

      This Jira tracks a few improvements to DataNode’s usage of DiskChecker to address the following problems:

      1. Checks are serialized so a single slow disk can indefinitely delay checking the rest.
      2. Related to 1, no detection of stalled checks.
      3. Lack of granularity. A single IO error initiates checking all disks.
      4. Inconsistent activation. Some DataNode IO failures trigger disk checks but not all.

      Attachments

        There are no Sub-Tasks for this issue.

        Activity

          People

            arp Arpit Agarwal
            arp Arpit Agarwal
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: