Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Summary of changes to the decommissioning process:
      # After nodes are decommissioned, they are not shutdown. The decommissioned nodes are not used for writes. For reads, the decommissioned nodes are given as the last location to read from.
      # Number of live and dead decommissioned nodes are displayed in the namenode webUI.
      # Decommissioned nodes free capacity is not count towards the the cluster free capacity.
      Show
      Summary of changes to the decommissioning process: # After nodes are decommissioned, they are not shutdown. The decommissioned nodes are not used for writes. For reads, the decommissioned nodes are given as the last location to read from. # Number of live and dead decommissioned nodes are displayed in the namenode webUI. # Decommissioned nodes free capacity is not count towards the the cluster free capacity.

      Description

      Current decommission mechanism driven using exclude file has several issues. This bug proposes some changes in the mechanism for better manageability. See the proposal in the next comment for more details.

      1. HDFS-1547.patch
        25 kB
        Suresh Srinivas
      2. HDFS-1547.1.patch
        25 kB
        Suresh Srinivas
      3. show-stats-broken.txt
        26 kB
        Todd Lipcon
      4. HDFS-1547.2.patch
        51 kB
        Suresh Srinivas
      5. HDFS-1547.3.patch
        52 kB
        Suresh Srinivas
      6. HDFS-1547.4.patch
        52 kB
        Suresh Srinivas

        Issue Links

          Activity

          Suresh Srinivas created issue -
          Suresh Srinivas made changes -
          Field Original Value New Value
          Attachment HDFS-1547.patch [ 12468077 ]
          Suresh Srinivas made changes -
          Attachment HDFS-1547.1.patch [ 12468084 ]
          Tsz Wo Nicholas Sze made changes -
          Hadoop Flags [Reviewed]
          Suresh Srinivas made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Suresh Srinivas made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Suresh Srinivas made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Todd Lipcon made changes -
          Attachment show-stats-broken.txt [ 12468182 ]
          Suresh Srinivas made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Suresh Srinivas made changes -
          Attachment HDFS-1547.2.patch [ 12468302 ]
          Suresh Srinivas made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Suresh Srinivas made changes -
          Attachment HDFS-1547.3.patch [ 12468314 ]
          Suresh Srinivas made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Suresh Srinivas made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Suresh Srinivas made changes -
          Attachment HDFS-1547.4.patch [ 12468436 ]
          Suresh Srinivas made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Suresh Srinivas made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Suresh Srinivas made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Release Note Summary of changes to the decommissioning process:
          # After nodes are decommissioned, they are not shutdown. The decommissioned nodes are not used for writes. For reads, the decommissioned nodes are given as the last location to read from.
          # Number of live and dead decommissioned nodes are displayed in the namenode webUI.
          # Decommissioned nodes free capacity is not count towards the the cluster free capacity.
          Resolution Fixed [ 1 ]
          Suresh Srinivas made changes -
          Link This issue is blocked by MAPREDUCE-2276 [ MAPREDUCE-2276 ]
          Suresh Srinivas made changes -
          Link This issue is blocked by HDFS-1585 [ HDFS-1585 ]

            People

            • Assignee:
              Suresh Srinivas
              Reporter:
              Suresh Srinivas
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development