Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-10827

When there are unrecoverable ec block groups, Namenode Web UI shows "There are X missing blocks." but doesn't show the block names.

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0-alpha2
    • Component/s: erasure-coding
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      For RS-6-3, when there is one ec block group and
      1) 0~3 out of 9 internal blocks are missing, NN Web UI doesn't show any warns.
      2) 4~8 out of 9 internal blocks are missing, NN Web UI shows "There are 1 missing blocks." but doesn't show the block names. (please see case_2.png)
      3) 9 out of 9 internal blocks are missing, NN Web UI shows "There are 1 missing blocks." and also shows the block name. (please see case_3.png)

      We should fix the case 2). I think NN Web UI should show the block names since the ec block group is unrecoverable.

      The values come from JMX. "There are X missing blocks." is NumberOfMissingBlocks and the block names are CorruptFiles.

        Attachments

        1. case_2.png
          46 kB
          Takanobu Asanuma
        2. case_3.png
          52 kB
          Takanobu Asanuma
        3. HDFS-10827.1.patch
          8 kB
          Takanobu Asanuma
        4. HDFS-10827.2.patch
          9 kB
          Takanobu Asanuma
        5. HDFS-10827.3.patch
          8 kB
          Takanobu Asanuma
        6. HDFS-10827.4.patch
          7 kB
          Takanobu Asanuma

          Issue Links

            Activity

              People

              • Assignee:
                tasanuma0829 Takanobu Asanuma
                Reporter:
                tasanuma0829 Takanobu Asanuma
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: