[HADOOP-14616] Client fails to read a block with erasure code (XOR, native) when one of the data block is lost

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Affects Version/s: 3.0.0-beta1, 3.0.0-alpha4
• Fix Version/s: 3.0.0

Environment

x86_64 Ubuntu 16.04.02 LTS

• Hadoop Flags: Reviewed
• Assignee: Huafeng Wang
• Reporter: Ayappan
• Created: 30/Jun/17 09:38
• Updated: 05/Oct/17 02:22
• Resolved: 05/Oct/17 02:08

Description

TestXORCoder, TestXORRawCoderInteroperable2, TestNativeXORRawCoder are the testcases failing. All with the same error. This happens after the commit of HADOOP-14479

java.lang.InternalError: Invalid inputs
at org.apache.hadoop.io.erasurecode.rawcoder.NativeXORRawDecoder.decodeImpl(Native Method)
at org.apache.hadoop.io.erasurecode.rawcoder.NativeXORRawDecoder.performDecodeImpl(NativeXORRawDecoder.java:44)
at org.apache.hadoop.io.erasurecode.rawcoder.AbstractNativeRawDecoder.doDecode(AbstractNativeRawDecoder.java:58)
at org.apache.hadoop.io.erasurecode.rawcoder.AbstractNativeRawDecoder.doDecode(AbstractNativeRawDecoder.java:74)
at org.apache.hadoop.io.erasurecode.rawcoder.RawErasureDecoder.decode(RawErasureDecoder.java:105)
at org.apache.hadoop.io.erasurecode.rawcoder.RawErasureDecoder.decode(RawErasureDecoder.java:163)
at org.apache.hadoop.io.erasurecode.coder.ErasureDecodingStep.performCoding(ErasureDecodingStep.java:54)
at org.apache.hadoop.io.erasurecode.coder.TestErasureCoderBase.performCodingStep(TestErasureCoderBase.java:126)
at org.apache.hadoop.io.erasurecode.coder.TestErasureCoderBase.performTestCoding(TestErasureCoderBase.java:95)
at org.apache.hadoop.io.erasurecode.coder.TestErasureCoderBase.testCoding(TestErasureCoderBase.java:69)
at org.apache.hadoop.io.erasurecode.coder.TestXORCoder.testCodingNoDirectBuffer_erasing_p0(TestXORCoder.java:51)

Issue Links

• is broken by: HADOOP-14479 Erasurecode testcase failures with native enabled