Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-11986

Dfsadmin should report erasure coding related information separately

    Details

      Description

      dfsadmin -report command currently reports only the aggregated block stats like below.

      # hdfs dfsadmin -report
      Configured Capacity: 1498775814144 (1.36 TB)
      Present Capacity: 931852427264 (867.86 GB)
      DFS Remaining: 931805765632 (867.81 GB)
      DFS Used: 46661632 (44.50 MB)
      DFS Used%: 0.01%
      Under replicated blocks: 0
      Blocks with corrupt replicas: 0
      Missing blocks: 0
      Missing blocks (with replication factor 1): 0
      Pending deletion blocks: 0
      

      Just like fsck, the proposal is to make dfsadmin command to report erasure coding blockgroups stats separately, like below

      # hdfs dfsadmin -report
      Configured Capacity: 1498775814144 (1.36 TB)
      Present Capacity: 931852427264 (867.86 GB)
      DFS Remaining: 931805765632 (867.81 GB)
      DFS Used: 46661632 (44.50 MB)
      DFS Used%: 0.01%
      Replicated Blocks:
        Under replicated blocks: 0
        Blocks with corrupt replicas: 0
        Missing blocks: 0
        Missing blocks (with replication factor 1): 0
        Pending deletion blocks: 0
      Erasure Coded Block Groups:
        Under ec block groups: 0
        EC block groups with corrupt internal blocks: 0
        Missing ec block groups: 0
        Pending deletion ec block groups: 0
      

      Erasure coding specific details needed for this enhancements are already made available as part of HDFS-10999.

        Attachments

        1. HDFS-11986.02.patch
          15 kB
          Manoj Govindassamy
        2. HDFS-11986.01.patch
          15 kB
          Manoj Govindassamy

          Activity

            People

            • Assignee:
              manojg Manoj Govindassamy
              Reporter:
              manojg Manoj Govindassamy
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: