Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1161

Make DN minimum valid volumes configurable

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.21.0, 0.22.0
    • 0.21.0
    • datanode
    • None
    • Reviewed

    Description

      The minimum number of non-faulty volumes to keep the DN active is hard-coded to 1. It would be useful to allow users to configure this value so the DN can be taken offline when eg half of its disks fail, otherwise it doesn't get reported until it's down to it's final disk and suffering degraded performance.

      Attachments

        1. HDFS-1161-y20.patch
          16 kB
          Konstantin Shvachko
        2. hdfs-1161-6.patch
          5 kB
          Eli Collins
        3. hdfs-1161-5.patch
          4 kB
          Eli Collins
        4. hdfs-1161-4.patch
          12 kB
          Eli Collins
        5. hdfs-1161-3.patch
          11 kB
          Eli Collins
        6. hdfs-1161-2.patch
          9 kB
          Eli Collins
        7. hdfs-1161-1.patch
          9 kB
          Eli Collins

        Issue Links

        blocks

        New Feature - A new feature of the product, which has yet to be developed. HDFS-811 Add metrics, failure reporting and additional tests for HDFS-457

        • Minor - Minor loss of function, or other problem where easy workaround is present.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-1160 Improve some FSDataset warnings and comments

        • Major - Major loss of function.
        • Closed
        relates to

        Bug - A problem which impairs or prevents the functions of the product. HDFS-1158 HDFS-457 increases the chances of losing blocks

        • Major - Major loss of function.
        • Resolved

        Improvement - An improvement or enhancement to an existing feature or task. HDFS-1565 Make DataNode respect dfs.datanode.failed.volumes.tolerated at startup

        • Major - Major loss of function.
        • Resolved

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            eli Eli Collins
            eli Eli Collins
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment