[HDFS-11986] Dfsadmin should report erasure coding related information separately

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0-alpha1
• Fix Version/s: 3.0.0-beta1
• Component/s: erasure-coding, hdfs
• Labels: hdfs-ec-3.0-nice-to-have
• Target Version/s: 3.0.0-beta1
• Assignee: Manoj Govindassamy
• Reporter: Manoj Govindassamy
• Created: 16/Jun/17 19:00
• Updated: 26/Aug/17 01:20
• Resolved: 26/Aug/17 00:30

Description

dfsadmin -report command currently reports only the aggregated block stats like below.

# hdfs dfsadmin -report
Configured Capacity: 1498775814144 (1.36 TB)
Present Capacity: 931852427264 (867.86 GB)
DFS Remaining: 931805765632 (867.81 GB)
DFS Used: 46661632 (44.50 MB)
DFS Used%: 0.01%
Under replicated blocks: 0
Blocks with corrupt replicas: 0
Missing blocks: 0
Missing blocks (with replication factor 1): 0
Pending deletion blocks: 0

Just like fsck, the proposal is to make dfsadmin command to report erasure coding blockgroups stats separately, like below

# hdfs dfsadmin -report
Configured Capacity: 1498775814144 (1.36 TB)
Present Capacity: 931852427264 (867.86 GB)
DFS Remaining: 931805765632 (867.81 GB)
DFS Used: 46661632 (44.50 MB)
DFS Used%: 0.01%
Replicated Blocks:
  Under replicated blocks: 0
  Blocks with corrupt replicas: 0
  Missing blocks: 0
  Missing blocks (with replication factor 1): 0
  Pending deletion blocks: 0
Erasure Coded Block Groups:
  Under ec block groups: 0
  EC block groups with corrupt internal blocks: 0
  Missing ec block groups: 0
  Pending deletion ec block groups: 0

Erasure coding specific details needed for this enhancements are already made available as part of HDFS-10999.