Description
TestAvroStorage fail on some platform (such as CentOs5) with the message:
org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:223)
at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
at org.apache.avro.file.SnappyCodec.compress(SnappyCodec.java:43)
at org.apache.avro.file.DataFileStream$DataBlock.compressUsing(DataFileStream.java:349)
at org.apache.avro.file.DataFileWriter.writeBlock(DataFileWriter.java:348)
at org.apache.avro.file.DataFileWriter.sync(DataFileWriter.java:360)
at org.apache.avro.file.DataFileWriter.flush(DataFileWriter.java:367)
at org.apache.avro.file.DataFileWriter.close(DataFileWriter.java:375)
at org.apache.avro.tool.DataFileWriteTool.run(DataFileWriteTool.java:111)
at org.apache.pig.builtin.TestAvroStorage.generateAvroFile(TestAvroStorage.java:269)
at org.apache.pig.builtin.TestAvroStorage.generateInputFiles(TestAvroStorage.java:223)
at org.apache.pig.builtin.TestAvroStorage.setup(TestAvroStorage.java:127)
This seems to be a bug in snapp-java, more information can be found in https://github.com/xerial/snappy-java/issues/17
Upgrade snappy-java to 1.1.0-M4 solves the issue.