Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10744

LZ4 Compression fails to recognize PowerPC Little Endian Architecture

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.4.1, 2.5.2
    • 2.6.0
    • io, native
    • None
    • PowerPC Little Endian (ppc64le)

    Description

      Lz4 Compression fails to identify the PowerPC Little Endian Architecture. It recognizes it as Big Endian and several testcases( TestCompressorDecompressor, TestCodec, TestLz4CompressorDecompressor) fails due to this.

      Running org.apache.hadoop.io.compress.TestCompressorDecompressor
      Tests run: 2, Failures: 2, Errors: 0, Skipped: 0, Time elapsed: 0.435 sec <<< FAILURE! - in org.apache.hadoop.io.compress.TestCompressorDecompressor
      testCompressorDecompressor(org.apache.hadoop.io.compress.TestCompressorDecompressor) Time elapsed: 0.308 sec <<< FAILURE!
      org.junit.internal.ArrayComparisonFailure: org.apache.hadoop.io.compress.lz4.Lz4Compressor_org.apache.hadoop.io.compress.lz4.Lz4Decompressor- byte arrays not equals error !!!: arrays first differed at element [1428]; expected:<4> but was:<10>
      at org.junit.internal.ComparisonCriteria.arrayEquals(ComparisonCriteria.java:50)
      at org.junit.Assert.internalArrayEquals(Assert.java:473)
      at org.junit.Assert.assertArrayEquals(Assert.java:294)
      at org.apache.hadoop.io.compress.CompressDecompressTester$CompressionTestStrategy$2.assertCompression(CompressDecompressTester.java:325)
      at org.apache.hadoop.io.compress.CompressDecompressTester.test(CompressDecompressTester.java:135)
      at org.apache.hadoop.io.compress.TestCompressorDecompressor.testCompressorDecompressor(TestCompressorDecompressor.java:58)
      .......
      .......
      .....

      Attachments

        1. HADOOP-10744.patch
          0.7 kB
          Ayappan
        2. HADOOP-10744-v1.patch
          0.7 kB
          Ayappan
        3. HADOOP-10744-v2.patch
          0.7 kB
          Ayappan
        4. HADOOP-10744-v3.patch
          0.6 kB
          Ayappan
        5. HADOOP-10744-v4.patch
          0.6 kB
          Ayappan

        Issue Links

          Activity

            People

              mrbsd Bert Sanders
              Ayappan Ayappan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: