Hadoop Common
  1. Hadoop Common
  2. HADOOP-4281

Capacity reported in some of the commands is not consistent with the Web UI reported data

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.19.0
    • Fix Version/s: 0.19.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Hide
      Changed command "hadoop dfsadmin -report" to be consistent with Web UI for both Namenode and Datanode reports. "Total raw bytes" is changed to "Configured Capacity". "Present Capacity" is newly added to indicate the present capacity of the DFS. "Remaining raw bytes" is changed to "DFS Remaining". "Used raw bytes" is changed to "DFS Used". "% used" is changed to "DFS Used%". Applications that parse command output should be reviewed.
      Show
      Changed command "hadoop dfsadmin -report" to be consistent with Web UI for both Namenode and Datanode reports. "Total raw bytes" is changed to "Configured Capacity". "Present Capacity" is newly added to indicate the present capacity of the DFS. "Remaining raw bytes" is changed to "DFS Remaining". "Used raw bytes" is changed to "DFS Used". "% used" is changed to "DFS Used%". Applications that parse command output should be reviewed.

      Description

      Changes submitted for 2816 changed the Web UI to report the capacity differently. The same changes need to be applied to commands that show namenode and datanode capacities

      1. HADOOP-4281.patch
        4 kB
        Suresh Srinivas
      2. HADOOP-4281.patch
        4 kB
        Suresh Srinivas

        Issue Links

          Activity

          Suresh Srinivas created issue -
          Suresh Srinivas made changes -
          Field Original Value New Value
          Attachment HADOOP-4281.patch [ 12391076 ]
          Suresh Srinivas made changes -
          Priority Major [ 3 ] Blocker [ 1 ]
          Hairong Kuang made changes -
          Fix Version/s 0.20.0 [ 12313438 ]
          Fix Version/s 0.19.0 [ 12313211 ]
          Suresh Srinivas made changes -
          Attachment HADOOP-4281.patch [ 12391171 ]
          Suresh Srinivas made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note Changes made (See corresponding Web UI change in 2816), to the command "hadoop dfsadmin -report". The following changes are made for both Namenode and Datanode reports:
          - "Total raw bytes" is changed to "Configured Capacity". Previously this data included the disk space for all the data directories. Now it excludes reserved space configured using dfs.datanode.du.reserved config param.
          - "Present Capacity" is newly added to indicate the present capacity of the DFS. This is sum of the remaining and used capacity.
          - "Remaining raw bytes" is changed to "DFS Remaining"
          - "Used raw bytes" is changed to "DFS Used"
          - "% used" is changed to "DFS Used%". It is the percentage of used capacity over "Present Capacity" instead of "Total raw bytes".
          Hadoop Flags [Incompatible change, Reviewed]
          Chris Douglas made changes -
          Link This issue relates to HADOOP-2816 [ HADOOP-2816 ]
          Chris Douglas made changes -
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Resolution Fixed [ 1 ]
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Robert Chansler made changes -
          Release Note Changes made (See corresponding Web UI change in 2816), to the command "hadoop dfsadmin -report". The following changes are made for both Namenode and Datanode reports:
          - "Total raw bytes" is changed to "Configured Capacity". Previously this data included the disk space for all the data directories. Now it excludes reserved space configured using dfs.datanode.du.reserved config param.
          - "Present Capacity" is newly added to indicate the present capacity of the DFS. This is sum of the remaining and used capacity.
          - "Remaining raw bytes" is changed to "DFS Remaining"
          - "Used raw bytes" is changed to "DFS Used"
          - "% used" is changed to "DFS Used%". It is the percentage of used capacity over "Present Capacity" instead of "Total raw bytes".
          Changed command "hadoop dfsadmin -report" to be consistent with Web UI for both Namenode and Datanode reports. "Total raw bytes" is changed to "Configured Capacity". "Present Capacity" is newly added to indicate the present capacity of the DFS. "Remaining raw bytes" is changed to "DFS Remaining". "Used raw bytes" is changed to "DFS Used". "% used" is changed to "DFS Used%". Applications that parse command output should be reviewed.
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Robert Chansler made changes -
          Component/s dfs [ 12310710 ]
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Nigel Daley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Jakob Homan made changes -
          Link This issue relates to HADOOP-5094 [ HADOOP-5094 ]
          Owen O'Malley made changes -
          Component/s dfs [ 12310710 ]

            People

            • Assignee:
              Suresh Srinivas
              Reporter:
              Suresh Srinivas
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development