[PIG-3820] TestAvroStorage fail on some OS

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.1, 0.13.0
• Hadoop Flags: Reviewed
• Assignee: Daniel Dai
• Reporter: Daniel Dai
• Created: 19/Mar/14 21:23
• Updated: 15/Apr/14 20:45
• Resolved: 19/Mar/14 23:10

Description

See test fail on SUSE11, CentOS5, CentOS6. Error message:
org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:223)
at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
at org.apache.avro.file.SnappyCodec.compress(SnappyCodec.java:43)
at org.apache.avro.file.DataFileStream$DataBlock.compressUsing(DataFileStream.java:349)
at org.apache.avro.file.DataFileWriter.writeBlock(DataFileWriter.java:348)
at org.apache.avro.file.DataFileWriter.sync(DataFileWriter.java:360)
at org.apache.avro.file.DataFileWriter.flush(DataFileWriter.java:367)
at org.apache.avro.file.DataFileWriter.close(DataFileWriter.java:375)
at org.apache.avro.tool.DataFileWriteTool.run(DataFileWriteTool.java:111)
at org.apache.pig.builtin.TestAvroStorage.generateAvroFile(TestAvroStorage.java:269)
at org.apache.pig.builtin.TestAvroStorage.generateInputFiles(TestAvroStorage.java:223)
at org.apache.pig.builtin.TestAvroStorage.setup(TestAvroStorage.java:127)

Seems we hit https://github.com/xerial/snappy-java/issues/17

Upgrade snappy-java version make the test failure go away.