Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10744

LZ4 Compression fails to recognize PowerPC Little Endian Architecture

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.4.1, 2.5.2
    • Fix Version/s: 2.6.0
    • Component/s: io, native
    • Labels:
      None
    • Environment:

      PowerPC Little Endian (ppc64le)

      Description

      Lz4 Compression fails to identify the PowerPC Little Endian Architecture. It recognizes it as Big Endian and several testcases( TestCompressorDecompressor, TestCodec, TestLz4CompressorDecompressor) fails due to this.

      Running org.apache.hadoop.io.compress.TestCompressorDecompressor
      Tests run: 2, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 0.435 sec <<< FAILURE! - in org.apache.hadoop.io.compress.TestCompressorDecompressor
      testCompressorDecompressor(org.apache.hadoop.io.compress.TestCompressorDecompressor) Time elapsed: 0.308 sec <<< FAILURE!
      org.junit.internal.ArrayComparisonFailure: org.apache.hadoop.io.compress.lz4.Lz4Compressor_org.apache.hadoop.io.compress.lz4.Lz4Decompressor- byte arrays not equals error !!!: arrays first differed at element [1428]; expected:<4> but was:<10>
      at org.junit.internal.ComparisonCriteria.arrayEquals(ComparisonCriteria.java:50)
      at org.junit.Assert.internalArrayEquals(Assert.java:473)
      at org.junit.Assert.assertArrayEquals(Assert.java:294)
      at org.apache.hadoop.io.compress.CompressDecompressTester$CompressionTestStrategy$2.assertCompression(CompressDecompressTester.java:325)
      at org.apache.hadoop.io.compress.CompressDecompressTester.test(CompressDecompressTester.java:135)
      at org.apache.hadoop.io.compress.TestCompressorDecompressor.testCompressorDecompressor(TestCompressorDecompressor.java:58)
      .......
      .......
      .....

        Attachments

        1. HADOOP-10744-v4.patch
          0.6 kB
          Ayappan
        2. HADOOP-10744-v3.patch
          0.6 kB
          Ayappan
        3. HADOOP-10744-v2.patch
          0.7 kB
          Ayappan
        4. HADOOP-10744-v1.patch
          0.7 kB
          Ayappan
        5. HADOOP-10744.patch
          0.7 kB
          Ayappan

          Issue Links

            Activity

              People

              • Assignee:
                mrbsd Bert Sanders
                Reporter:
                Ayappan Ayappan
              • Votes:
                0 Vote for this issue
                Watchers:
                3 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: