[HDFS-2554] Add separate metrics for missing blocks with desired replication level 1

• Type: Improvement
• Status: Resolved
• Priority: Minor
• Resolution: Duplicate
• Affects Version/s: 2.0.0-alpha
• Component/s: namenode
• Assignee: Andy Isaacson
• Reporter: Todd Lipcon
• Created: 15/Nov/11 21:11
• Updated: 09/Jul/15 19:19
• Resolved: 09/Jul/15 19:19

Description

Some users use replication level set to 1 for datasets which are unimportant and can be lost with no worry (eg the output of terasort tests). But other data on the cluster is important and should not be lost. It would be useful to separate the metric for missing blocks by the desired replication level of those blocks, so that one could ignore missing blocks at repl 1 while still alerting on missing blocks with higher desired replication.

Issue Links

• duplicates: HDFS-7165 Separate block metrics for files with replication count 1
• is related to: HDFS-3764 Hadoop fsck reports files with blocks w/o live replicas as corrupt
• is related to: HDFS-3998 Speed up fsck
• is related to: HDFS-4324 Track and report out-of-date blocks separately from corrupt blocks