Hadoop Common
  1. Hadoop Common
  2. HADOOP-4281

Capacity reported in some of the commands is not consistent with the Web UI reported data

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.19.0
    • Fix Version/s: 0.19.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Incompatible change, Reviewed
    • Release Note:
      Hide
      Changed command "hadoop dfsadmin -report" to be consistent with Web UI for both Namenode and Datanode reports. "Total raw bytes" is changed to "Configured Capacity". "Present Capacity" is newly added to indicate the present capacity of the DFS. "Remaining raw bytes" is changed to "DFS Remaining". "Used raw bytes" is changed to "DFS Used". "% used" is changed to "DFS Used%". Applications that parse command output should be reviewed.
      Show
      Changed command "hadoop dfsadmin -report" to be consistent with Web UI for both Namenode and Datanode reports. "Total raw bytes" is changed to "Configured Capacity". "Present Capacity" is newly added to indicate the present capacity of the DFS. "Remaining raw bytes" is changed to "DFS Remaining". "Used raw bytes" is changed to "DFS Used". "% used" is changed to "DFS Used%". Applications that parse command output should be reviewed.

      Description

      Changes submitted for 2816 changed the Web UI to report the capacity differently. The same changes need to be applied to commands that show namenode and datanode capacities

      1. HADOOP-4281.patch
        4 kB
        Suresh Srinivas
      2. HADOOP-4281.patch
        4 kB
        Suresh Srinivas

        Issue Links

          Activity

          Owen O'Malley made changes -
          Component/s dfs [ 12310710 ]
          Jakob Homan made changes -
          Link This issue relates to HADOOP-5094 [ HADOOP-5094 ]
          Nigel Daley made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Robert Chansler made changes -
          Component/s dfs [ 12310710 ]
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Robert Chansler made changes -
          Release Note Changes made (See corresponding Web UI change in 2816), to the command "hadoop dfsadmin -report". The following changes are made for both Namenode and Datanode reports:
          - "Total raw bytes" is changed to "Configured Capacity". Previously this data included the disk space for all the data directories. Now it excludes reserved space configured using dfs.datanode.du.reserved config param.
          - "Present Capacity" is newly added to indicate the present capacity of the DFS. This is sum of the remaining and used capacity.
          - "Remaining raw bytes" is changed to "DFS Remaining"
          - "Used raw bytes" is changed to "DFS Used"
          - "% used" is changed to "DFS Used%". It is the percentage of used capacity over "Present Capacity" instead of "Total raw bytes".
          Changed command "hadoop dfsadmin -report" to be consistent with Web UI for both Namenode and Datanode reports. "Total raw bytes" is changed to "Configured Capacity". "Present Capacity" is newly added to indicate the present capacity of the DFS. "Remaining raw bytes" is changed to "DFS Remaining". "Used raw bytes" is changed to "DFS Used". "% used" is changed to "DFS Used%". Applications that parse command output should be reviewed.
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Chris Douglas made changes -
          Hadoop Flags [Reviewed, Incompatible change] [Incompatible change, Reviewed]
          Resolution Fixed [ 1 ]
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Chris Douglas made changes -
          Link This issue relates to HADOOP-2816 [ HADOOP-2816 ]
          Suresh Srinivas made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note Changes made (See corresponding Web UI change in 2816), to the command "hadoop dfsadmin -report". The following changes are made for both Namenode and Datanode reports:
          - "Total raw bytes" is changed to "Configured Capacity". Previously this data included the disk space for all the data directories. Now it excludes reserved space configured using dfs.datanode.du.reserved config param.
          - "Present Capacity" is newly added to indicate the present capacity of the DFS. This is sum of the remaining and used capacity.
          - "Remaining raw bytes" is changed to "DFS Remaining"
          - "Used raw bytes" is changed to "DFS Used"
          - "% used" is changed to "DFS Used%". It is the percentage of used capacity over "Present Capacity" instead of "Total raw bytes".
          Hadoop Flags [Incompatible change, Reviewed]
          Suresh Srinivas made changes -
          Attachment HADOOP-4281.patch [ 12391171 ]
          Hairong Kuang made changes -
          Fix Version/s 0.20.0 [ 12313438 ]
          Fix Version/s 0.19.0 [ 12313211 ]
          Suresh Srinivas made changes -
          Priority Major [ 3 ] Blocker [ 1 ]
          Suresh Srinivas made changes -
          Field Original Value New Value
          Attachment HADOOP-4281.patch [ 12391076 ]
          Suresh Srinivas created issue -

            People

            • Assignee:
              Suresh Srinivas
              Reporter:
              Suresh Srinivas
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development