Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-4324

Track and report out-of-date blocks separately from corrupt blocks

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.0.0-alpha1
    • None
    • namenode
    • None

    Description

      Currently in various places (metrics, dfsadmin -report, fsck, logs) we use the term "corrupt" to refer to blocks which have an out-of-date generation stamp. Since out-of-date blocks are a fairly normal occurrence if a DN restarts while data is being written, we should be avoid using 'scary' works like corrupt. This may need both some textual changes as well as some internal changes to count the corruption types distinctly.

      Attachments

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-2554 Add separate metrics for missing blocks with desired replication level 1

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-5189 Rename the "CorruptBlocks" metric to "CorruptReplicas"

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Patch Available

          Activity

            People

              Unassigned Unassigned
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated: