[HADOOP-10744] LZ4 Compression fails to recognize PowerPC Little Endian Architecture

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.1, 2.5.2
• Fix Version/s: 2.6.0
• Component/s: io, native

Environment

PowerPC Little Endian (ppc64le)

• Assignee: Bert Sanders
• Reporter: Ayappan
• Created: 24/Jun/14 09:39
• Updated: 30/Jun/15 07:22
• Resolved: 04/Feb/15 10:12

Description

Lz4 Compression fails to identify the PowerPC Little Endian Architecture. It recognizes it as Big Endian and several testcases( TestCompressorDecompressor, TestCodec, TestLz4CompressorDecompressor) fails due to this.

Running org.apache.hadoop.io.compress.TestCompressorDecompressor
Tests run: 2, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 0.435 sec <<< FAILURE! - in org.apache.hadoop.io.compress.TestCompressorDecompressor
testCompressorDecompressor(org.apache.hadoop.io.compress.TestCompressorDecompressor) Time elapsed: 0.308 sec <<< FAILURE!
org.junit.internal.ArrayComparisonFailure: org.apache.hadoop.io.compress.lz4.Lz4Compressor_org.apache.hadoop.io.compress.lz4.Lz4Decompressor- byte arrays not equals error !!!: arrays first differed at element [1428]; expected:<4> but was:<10>
at org.junit.internal.ComparisonCriteria.arrayEquals(ComparisonCriteria.java:50)
at org.junit.Assert.internalArrayEquals(Assert.java:473)
at org.junit.Assert.assertArrayEquals(Assert.java:294)
at org.apache.hadoop.io.compress.CompressDecompressTester$CompressionTestStrategy$2.assertCompression(CompressDecompressTester.java:325)
at org.apache.hadoop.io.compress.CompressDecompressTester.test(CompressDecompressTester.java:135)
at org.apache.hadoop.io.compress.TestCompressorDecompressor.testCompressorDecompressor(TestCompressorDecompressor.java:58)
.......
.......
.....

Issue Links

• is part of: HADOOP-11184 Update Hadoop's lz4 to r123