Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-10827

When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha2
    • erasure-coding
    • None
    • Reviewed

    Description

      For RS-6-3, when there is one ec block group and
      1) 0~3 out of 9 internal blocks are missing, NN Web UI doesn't show any warns.
      2) 4~8 out of 9 internal blocks are missing, NN Web UI shows "There are 1 missing blocks." but doesn't show the block names. (please see case_2.png)
      3) 9 out of 9 internal blocks are missing, NN Web UI shows "There are 1 missing blocks." and also shows the block name. (please see case_3.png)

      We should fix the case 2). I think NN Web UI should show the block names since the ec block group is unrecoverable.

      The values come from JMX. "There are X missing blocks." is NumberOfMissingBlocks and the block names are CorruptFiles.

      Attachments

        1. HDFS-10827.4.patch
          7 kB
          Takanobu Asanuma
        2. HDFS-10827.3.patch
          8 kB
          Takanobu Asanuma
        3. HDFS-10827.2.patch
          9 kB
          Takanobu Asanuma
        4. HDFS-10827.1.patch
          8 kB
          Takanobu Asanuma
        5. case_3.png
          52 kB
          Takanobu Asanuma
        6. case_2.png
          46 kB
          Takanobu Asanuma

        Issue Links

          Activity

            People

              tasanuma Takanobu Asanuma
              tasanuma Takanobu Asanuma
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: