Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10316

revisit corrupt replicas count

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      A DN has 4 types of storages:
      1. NORMAL
      2. READ_ONLY
      3. FAILED
      4. (missing/pruned)

      blocksMap.numNodes(blk) counts 1,2,3
      blocksMap.getStorages(blk) counts 1,2,3

      countNodes(blk).corruptReplicas() counts 1,2
      corruptReplicas counts 1,2,3,4. Because findAndMarkBlockAsCorrupt(..) supports adding blk to the map even if the storage is not found.

      The inconsistency causes bugs like HDFS-9958.

        Attachments

        1. HDFS-10316.001.patch
          2 kB
          Yiqun Lin

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                walter.k.su Walter Su
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated: