Uploaded image for project: 'Pig'
  1. Pig
  2. PIG-3820

TestAvroStorage fail on some OS

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.12.1, 0.13.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      See test fail on SUSE11, CentOS5, CentOS6. Error message:
      org.xerial.snappy.SnappyError: [FAILED_TO_LOAD_NATIVE_LIBRARY] null
      at org.xerial.snappy.SnappyLoader.load(SnappyLoader.java:223)
      at org.xerial.snappy.Snappy.<clinit>(Snappy.java:48)
      at org.apache.avro.file.SnappyCodec.compress(SnappyCodec.java:43)
      at org.apache.avro.file.DataFileStream$DataBlock.compressUsing(DataFileStream.java:349)
      at org.apache.avro.file.DataFileWriter.writeBlock(DataFileWriter.java:348)
      at org.apache.avro.file.DataFileWriter.sync(DataFileWriter.java:360)
      at org.apache.avro.file.DataFileWriter.flush(DataFileWriter.java:367)
      at org.apache.avro.file.DataFileWriter.close(DataFileWriter.java:375)
      at org.apache.avro.tool.DataFileWriteTool.run(DataFileWriteTool.java:111)
      at org.apache.pig.builtin.TestAvroStorage.generateAvroFile(TestAvroStorage.java:269)
      at org.apache.pig.builtin.TestAvroStorage.generateInputFiles(TestAvroStorage.java:223)
      at org.apache.pig.builtin.TestAvroStorage.setup(TestAvroStorage.java:127)

      Seems we hit https://github.com/xerial/snappy-java/issues/17

      Upgrade snappy-java version make the test failure go away.

        Attachments

        1. PIG-3820-1.patch
          0.5 kB
          Jianyong Dai

          Activity

            People

            • Assignee:
              daijy Jianyong Dai
              Reporter:
              daijy Jianyong Dai
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: