Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1547

Improve decommission mechanism

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.23.0
    • 0.23.0
    • namenode
    • None
    • Reviewed
    • Hide
      Summary of changes to the decommissioning process:
      # After nodes are decommissioned, they are not shutdown. The decommissioned nodes are not used for writes. For reads, the decommissioned nodes are given as the last location to read from.
      # Number of live and dead decommissioned nodes are displayed in the namenode webUI.
      # Decommissioned nodes free capacity is not count towards the the cluster free capacity.
      Show
      Summary of changes to the decommissioning process: # After nodes are decommissioned, they are not shutdown. The decommissioned nodes are not used for writes. For reads, the decommissioned nodes are given as the last location to read from. # Number of live and dead decommissioned nodes are displayed in the namenode webUI. # Decommissioned nodes free capacity is not count towards the the cluster free capacity.

    Description

      Current decommission mechanism driven using exclude file has several issues. This bug proposes some changes in the mechanism for better manageability. See the proposal in the next comment for more details.

      Attachments

        1. HDFS-1547.patch
          25 kB
          Suresh Srinivas
        2. HDFS-1547.1.patch
          25 kB
          Suresh Srinivas
        3. show-stats-broken.txt
          26 kB
          Todd Lipcon
        4. HDFS-1547.2.patch
          51 kB
          Suresh Srinivas
        5. HDFS-1547.3.patch
          52 kB
          Suresh Srinivas
        6. HDFS-1547.4.patch
          52 kB
          Suresh Srinivas

        Issue Links

          Activity

            People

              sureshms Suresh Srinivas
              sureshms Suresh Srinivas
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: