Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1547

Improve decommission mechanism

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.23.0
    • 0.23.0
    • namenode
    • None
    • Reviewed
    • Hide
      Summary of changes to the decommissioning process:
      # After nodes are decommissioned, they are not shutdown. The decommissioned nodes are not used for writes. For reads, the decommissioned nodes are given as the last location to read from.
      # Number of live and dead decommissioned nodes are displayed in the namenode webUI.
      # Decommissioned nodes free capacity is not count towards the the cluster free capacity.
      Show
      Summary of changes to the decommissioning process: # After nodes are decommissioned, they are not shutdown. The decommissioned nodes are not used for writes. For reads, the decommissioned nodes are given as the last location to read from. # Number of live and dead decommissioned nodes are displayed in the namenode webUI. # Decommissioned nodes free capacity is not count towards the the cluster free capacity.

    Description

      Current decommission mechanism driven using exclude file has several issues. This bug proposes some changes in the mechanism for better manageability. See the proposal in the next comment for more details.

      Attachments

        1. HDFS-1547.4.patch
          52 kB
          Suresh Srinivas
        2. HDFS-1547.3.patch
          52 kB
          Suresh Srinivas
        3. HDFS-1547.2.patch
          51 kB
          Suresh Srinivas
        4. show-stats-broken.txt
          26 kB
          Todd Lipcon
        5. HDFS-1547.1.patch
          25 kB
          Suresh Srinivas
        6. HDFS-1547.patch
          25 kB
          Suresh Srinivas

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            sureshms Suresh Srinivas
            sureshms Suresh Srinivas
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment