Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3513

Upgrade snappy.java to 1.1.0-M4

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Duplicate
    • None
    • 0.13.0
    • impl
    • None

    Description

      TestAvroStorage fail on some platform (such as CentOs5) with the message:
      org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
      at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:223)
      at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
      at org.apache.avro.file.SnappyCodec.compress(SnappyCodec.java:43)
      at org.apache.avro.file.DataFileStream$DataBlock.compressUsing(DataFileStream.java:349)
      at org.apache.avro.file.DataFileWriter.writeBlock(DataFileWriter.java:348)
      at org.apache.avro.file.DataFileWriter.sync(DataFileWriter.java:360)
      at org.apache.avro.file.DataFileWriter.flush(DataFileWriter.java:367)
      at org.apache.avro.file.DataFileWriter.close(DataFileWriter.java:375)
      at org.apache.avro.tool.DataFileWriteTool.run(DataFileWriteTool.java:111)
      at org.apache.pig.builtin.TestAvroStorage.generateAvroFile(TestAvroStorage.java:269)
      at org.apache.pig.builtin.TestAvroStorage.generateInputFiles(TestAvroStorage.java:223)
      at org.apache.pig.builtin.TestAvroStorage.setup(TestAvroStorage.java:127)

      This seems to be a bug in snapp-java, more information can be found in https://github.com/xerial/snappy-java/issues/17

      Upgrade snappy-java to 1.1.0-M4 solves the issue.

      Attachments

        1. PIG-3513-1.patch
          0.4 kB
          Daniel Dai

        Activity

          People

            daijy Daniel Dai
            daijy Daniel Dai
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: