Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10625

VolumeScanner to report why a block is found bad

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.7.4
    • datanode, hdfs
    • Reviewed

    Description

      VolumeScanner may report:

      WARN org.apache.hadoop.hdfs.server.datanode.VolumeScanner: Reporting bad blk_1170125248_96458336 on /d/dfs/dn

      It would be helpful to report the reason why the block is bad, especially when the block is corrupt, where is the first corrupted chunk in the block.

      Attachments

        1. HDFS-10625-1.patch
          2 kB
          Rushabh Shah
        2. HDFS-10625.patch
          0.8 kB
          Rushabh Shah
        3. HDFS-10625.005.patch
          3 kB
          Rushabh Shah
        4. HDFS-10625.004.patch
          3 kB
          Yiqun Lin
        5. HDFS-10625.003.patch
          3 kB
          Yiqun Lin

        Issue Links

          is duplicated by

          Bug - A problem which impairs or prevents the functions of the product. HDFS-10626 VolumeScanner prints incorrect IOException in reportBadBlocks operation

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-10512 VolumeScanner may terminate due to NPE in DataNode.reportBadBlocks

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-10587 Incorrect offset/length calculation in pipeline recovery causes block corruption

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              shahrs87 Rushabh Shah
              yzhangal Yongjun Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: