Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-8031 Follow-on work for erasure coding phase I (striping layout)
  3. HDFS-9646

ErasureCodingWorker may fail when recovering data blocks with length less than the first internal block

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Critical
    • Resolution: Fixed
    • 3.0.0-alpha1
    • 3.0.0-alpha1
    • erasure-coding
    • None
    • Reviewed

    Description

      This is reported by tfukudom: ErasureCodingWorker may fail with the following exception when recovering a non-full internal block.

      2016-01-06 11:14:44,740 WARN  datanode.DataNode (ErasureCodingWorker.java:run(467)) - Failed to recover striped block: BP-987302662-172.29.4.13-1450757377698:blk_-92233720368
54322288_29751
java.io.IOException: Transfer failed for all targets.
        at org.apache.hadoop.hdfs.server.datanode.erasurecode.ErasureCodingWorker$ReconstructAndTransferBlock.run(ErasureCodingWorker.java:455)

      Attachments

        1. HDFS-9646.000.patch
          17 kB
          Jing Zhao
        2. HDFS-9646.001.patch
          17 kB
          Jing Zhao
        3. HDFS-9646.002.patch
          23 kB
          Jing Zhao
        4. HDFS-9646.003.patch
          39 kB
          Jing Zhao
        5. HDFS-9646.004.patch
          40 kB
          Jing Zhao
        6. test-reconstruct-stripe-file.patch
          4 kB
          Jing Zhao

        Issue Links

          duplicates

          Sub-task - The sub-task of the issue HDFS-9585 Erasure Coding: Wrong limit setting of target ByteBuffer

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              jingzhao Jing Zhao
              tfukudom Takuya Fukudome
              Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: