[MAPREDUCE-5645] TestFixedLengthInputFormat fails with native libs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.3.0, 3.0.0-alpha1
• Fix Version/s: 2.3.0
• Labels: native
• Assignee: Mit Desai
• Reporter: Jonathan Turner Eagles
• Created: 22/Nov/13 21:12
• Updated: 12/May/16 18:22
• Resolved: 03/Dec/13 22:55

Description

mvn clean install -Pnative -DskipTests
hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
mvn clean test -Dtest=TestFixedLengthInputFormat

Running org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat
Tests run: 8, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 39.957 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat
testGzipWithTwoInputs(org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat) Time elapsed: 0.029 sec <<< ERROR!
java.lang.NullPointerException: null
at org.apache.hadoop.io.compress.zlib.ZlibFactory.isNativeZlibLoaded(ZlibFactory.java:65)
at org.apache.hadoop.io.compress.GzipCodec.createOutputStream(GzipCodec.java:162)
at org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat.writeFile(TestFixedLengthInputFormat.java:397)
at org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat.testGzipWithTwoInputs(TestFixedLengthInputFormat.java:229)

testFormatCompressedIn(org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat) Time elapsed: 0.01 sec <<< ERROR!
java.lang.NullPointerException: null
at org.apache.hadoop.io.compress.zlib.ZlibFactory.isNativeZlibLoaded(ZlibFactory.java:65)
at org.apache.hadoop.io.compress.GzipCodec.createOutputStream(GzipCodec.java:162)
at org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat.createFile(TestFixedLengthInputFormat.java:261)
at org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat.runRandomTests(TestFixedLengthInputFormat.java:314)
at org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat.testFormatCompressedIn(TestFixedLengthInputFormat.java:96)

Running org.apache.hadoop.mapred.TestFixedLengthInputFormat
Tests run: 8, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 46.151 sec <<< FAILURE! - in org.apache.hadoop.mapred.TestFixedLengthInputFormat
testPartialRecordCompressedIn(org.apache.hadoop.mapred.TestFixedLengthInputFormat) Time elapsed: 0.031 sec <<< ERROR!
java.lang.NullPointerException: null
at org.apache.hadoop.io.compress.zlib.ZlibFactory.isNativeZlibLoaded(ZlibFactory.java:65)
at org.apache.hadoop.io.compress.GzipCodec.createOutputStream(GzipCodec.java:162)
at org.apache.hadoop.mapred.TestFixedLengthInputFormat.writeFile(TestFixedLengthInputFormat.java:357)
at org.apache.hadoop.mapred.TestFixedLengthInputFormat.runPartialRecordTest(TestFixedLengthInputFormat.java:386)
at org.apache.hadoop.mapred.TestFixedLengthInputFormat.testPartialRecordCompressedIn(TestFixedLengthInputFormat.java:182)

testGzipWithTwoInputs(org.apache.hadoop.mapred.TestFixedLengthInputFormat) Time elapsed: 0.009 sec <<< ERROR!
java.lang.NullPointerException: null
at org.apache.hadoop.io.compress.zlib.ZlibFactory.isNativeZlibLoaded(ZlibFactory.java:65)
at org.apache.hadoop.io.compress.GzipCodec.createOutputStream(GzipCodec.java:162)
at org.apache.hadoop.mapred.TestFixedLengthInputFormat.writeFile(TestFixedLengthInputFormat.java:357)
at org.apache.hadoop.mapred.TestFixedLengthInputFormat.testGzipWithTwoInputs(TestFixedLengthInputFormat.java:201)

testFormatCompressedIn(org.apache.hadoop.mapred.TestFixedLengthInputFormat) Time elapsed: 0.017 sec <<< ERROR!
java.lang.NullPointerException: null
at org.apache.hadoop.io.compress.zlib.ZlibFactory.isNativeZlibLoaded(ZlibFactory.java:65)
at org.apache.hadoop.io.compress.GzipCodec.createOutputStream(GzipCodec.java:162)
at org.apache.hadoop.mapred.TestFixedLengthInputFormat.createFile(TestFixedLengthInputFormat.java:234)
at org.apache.hadoop.mapred.TestFixedLengthInputFormat.runRandomTests(TestFixedLengthInputFormat.java:287)
at org.apache.hadoop.mapred.TestFixedLengthInputFormat.testFormatCompressedIn(TestFixedLengthInputFormat.java:90)

Results :

Tests in error:
TestFixedLengthInputFormat.testGzipWithTwoInputs:229->writeFile:397 » NullPointer
TestFixedLengthInputFormat.testFormatCompressedIn:96->runRandomTests:314->createFile:261 » NullPointer
TestFixedLengthInputFormat.testPartialRecordCompressedIn:182->runPartialRecordTest:386->writeFile:357 » NullPointer
TestFixedLengthInputFormat.testGzipWithTwoInputs:201->writeFile:357 » NullPointer
TestFixedLengthInputFormat.testFormatCompressedIn:90->runRandomTests:287->createFile:234 » NullPointer

Tests run: 16, Failures: 0, Errors: 5, Skipped: 0