[HDFS-8732] Erasure Coding: Fail to read a file with corrupted blocks

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Assignee: Walter Su
• Reporter: Xinwei Qin
• Created: 08/Jul/15 07:58
• Updated: 10/Jul/15 02:02
• Resolved: 10/Jul/15 02:02

Description

In system test of reading EC file(HDFS-8259), the methods testReadCorruptedData*() failed to read a EC file with corrupted blocks(overwrite some data to several blocks and this will make client get a checksum exception).

Exception logs:

java.lang.NullPointerException
at org.apache.hadoop.hdfs.DFSStripedInputStream$StatefulStripeReader.readChunk(DFSStripedInputStream.java:771)
at org.apache.hadoop.hdfs.DFSStripedInputStream$StripeReader.readStripe(DFSStripedInputStream.java:623)
at org.apache.hadoop.hdfs.DFSStripedInputStream.readOneStripe(DFSStripedInputStream.java:335)
at org.apache.hadoop.hdfs.DFSStripedInputStream.readWithStrategy(DFSStripedInputStream.java:465)
at org.apache.hadoop.hdfs.DFSInputStream.read(DFSInputStream.java:946)
at java.io.DataInputStream.read(DataInputStream.java:149)
at org.apache.hadoop.hdfs.StripedFileTestUtil.verifyStatefulRead(StripedFileTestUtil.java:98)
at org.apache.hadoop.hdfs.TestReadStripedFileWithDecoding.verifyRead(TestReadStripedFileWithDecoding.java:196)
at org.apache.hadoop.hdfs.TestReadStripedFileWithDecoding.testOneFileWithBlockCorrupted(TestReadStripedFileWithDecoding.java:246)
at org.apache.hadoop.hdfs.TestReadStripedFileWithDecoding.testReadCorruptedData11(TestReadStripedFileWithDecoding.java:114)

Issue Links

• duplicates: HDFS-8669 Erasure Coding: handle missing internal block locations in DFSStripedInputStream