Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-1547

Improve decommission mechanism

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.23.0
    • 0.23.0
    • namenode
    • None
    • Reviewed
    • Hide
      Summary of changes to the decommissioning process:
      # After nodes are decommissioned, they are not shutdown. The decommissioned nodes are not used for writes. For reads, the decommissioned nodes are given as the last location to read from.
      # Number of live and dead decommissioned nodes are displayed in the namenode webUI.
      # Decommissioned nodes free capacity is not count towards the the cluster free capacity.
      Show
      Summary of changes to the decommissioning process: # After nodes are decommissioned, they are not shutdown. The decommissioned nodes are not used for writes. For reads, the decommissioned nodes are given as the last location to read from. # Number of live and dead decommissioned nodes are displayed in the namenode webUI. # Decommissioned nodes free capacity is not count towards the the cluster free capacity.

    Description

      Current decommission mechanism driven using exclude file has several issues. This bug proposes some changes in the mechanism for better manageability. See the proposal in the next comment for more details.

      Attachments

        1. show-stats-broken.txt
          26 kB
          Todd Lipcon
        2. HDFS-1547.patch
          25 kB
          Suresh Srinivas
        3. HDFS-1547.4.patch
          52 kB
          Suresh Srinivas
        4. HDFS-1547.3.patch
          52 kB
          Suresh Srinivas
        5. HDFS-1547.2.patch
          51 kB
          Suresh Srinivas
        6. HDFS-1547.1.patch
          25 kB
          Suresh Srinivas

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-1585 HDFS-1547 broke MR build

          • Blocker - Blocks development and/or testing work, production could not run
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. MAPREDUCE-2276 Fix build failure introduced by HDFS-1547

          • Major - Major loss of function.
          • Closed

          Activity

            People

              sureshms Suresh Srinivas
              sureshms Suresh Srinivas
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: