Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-5645

TestFixedLengthInputFormat fails with native libs

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.3.0, 3.0.0-alpha1
    • Fix Version/s: 2.3.0
    • Component/s: None
    • Labels:
    • Target Version/s:

      Description

      mvn clean install -Pnative -DskipTests
      hadoop-mapreduce-project/hadoop-mapreduce-client/hadoop-mapreduce-client-jobclient
      mvn clean test -Dtest=TestFixedLengthInputFormat

      Running org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat
      Tests run: 8, Failures: 0, Errors: 2, Skipped: 0, Time elapsed: 39.957 sec <<< FAILURE! - in org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat
      testGzipWithTwoInputs(org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat) Time elapsed: 0.029 sec <<< ERROR!
      java.lang.NullPointerException: null
      at org.apache.hadoop.io.compress.zlib.ZlibFactory.isNativeZlibLoaded(ZlibFactory.java:65)
      at org.apache.hadoop.io.compress.GzipCodec.createOutputStream(GzipCodec.java:162)
      at org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat.writeFile(TestFixedLengthInputFormat.java:397)
      at org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat.testGzipWithTwoInputs(TestFixedLengthInputFormat.java:229)

      testFormatCompressedIn(org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat) Time elapsed: 0.01 sec <<< ERROR!
      java.lang.NullPointerException: null
      at org.apache.hadoop.io.compress.zlib.ZlibFactory.isNativeZlibLoaded(ZlibFactory.java:65)
      at org.apache.hadoop.io.compress.GzipCodec.createOutputStream(GzipCodec.java:162)
      at org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat.createFile(TestFixedLengthInputFormat.java:261)
      at org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat.runRandomTests(TestFixedLengthInputFormat.java:314)
      at org.apache.hadoop.mapreduce.lib.input.TestFixedLengthInputFormat.testFormatCompressedIn(TestFixedLengthInputFormat.java:96)

      Running org.apache.hadoop.mapred.TestFixedLengthInputFormat
      Tests run: 8, Failures: 0, Errors: 3, Skipped: 0, Time elapsed: 46.151 sec <<< FAILURE! - in org.apache.hadoop.mapred.TestFixedLengthInputFormat
      testPartialRecordCompressedIn(org.apache.hadoop.mapred.TestFixedLengthInputFormat) Time elapsed: 0.031 sec <<< ERROR!
      java.lang.NullPointerException: null
      at org.apache.hadoop.io.compress.zlib.ZlibFactory.isNativeZlibLoaded(ZlibFactory.java:65)
      at org.apache.hadoop.io.compress.GzipCodec.createOutputStream(GzipCodec.java:162)
      at org.apache.hadoop.mapred.TestFixedLengthInputFormat.writeFile(TestFixedLengthInputFormat.java:357)
      at org.apache.hadoop.mapred.TestFixedLengthInputFormat.runPartialRecordTest(TestFixedLengthInputFormat.java:386)
      at org.apache.hadoop.mapred.TestFixedLengthInputFormat.testPartialRecordCompressedIn(TestFixedLengthInputFormat.java:182)

      testGzipWithTwoInputs(org.apache.hadoop.mapred.TestFixedLengthInputFormat) Time elapsed: 0.009 sec <<< ERROR!
      java.lang.NullPointerException: null
      at org.apache.hadoop.io.compress.zlib.ZlibFactory.isNativeZlibLoaded(ZlibFactory.java:65)
      at org.apache.hadoop.io.compress.GzipCodec.createOutputStream(GzipCodec.java:162)
      at org.apache.hadoop.mapred.TestFixedLengthInputFormat.writeFile(TestFixedLengthInputFormat.java:357)
      at org.apache.hadoop.mapred.TestFixedLengthInputFormat.testGzipWithTwoInputs(TestFixedLengthInputFormat.java:201)

      testFormatCompressedIn(org.apache.hadoop.mapred.TestFixedLengthInputFormat) Time elapsed: 0.017 sec <<< ERROR!
      java.lang.NullPointerException: null
      at org.apache.hadoop.io.compress.zlib.ZlibFactory.isNativeZlibLoaded(ZlibFactory.java:65)
      at org.apache.hadoop.io.compress.GzipCodec.createOutputStream(GzipCodec.java:162)
      at org.apache.hadoop.mapred.TestFixedLengthInputFormat.createFile(TestFixedLengthInputFormat.java:234)
      at org.apache.hadoop.mapred.TestFixedLengthInputFormat.runRandomTests(TestFixedLengthInputFormat.java:287)
      at org.apache.hadoop.mapred.TestFixedLengthInputFormat.testFormatCompressedIn(TestFixedLengthInputFormat.java:90)

      Results :

      Tests in error:
      TestFixedLengthInputFormat.testGzipWithTwoInputs:229->writeFile:397 » NullPointer
      TestFixedLengthInputFormat.testFormatCompressedIn:96->runRandomTests:314->createFile:261 » NullPointer
      TestFixedLengthInputFormat.testPartialRecordCompressedIn:182->runPartialRecordTest:386->writeFile:357 » NullPointer
      TestFixedLengthInputFormat.testGzipWithTwoInputs:201->writeFile:357 » NullPointer
      TestFixedLengthInputFormat.testFormatCompressedIn:90->runRandomTests:287->createFile:234 » NullPointer

      Tests run: 16, Failures: 0, Errors: 5, Skipped: 0

        Attachments

        1. MAPREDUCE-5645.patch
          7 kB
          Mit Desai

          Activity

            People

            • Assignee:
              mitdesai Mit Desai
              Reporter:
              jeagles Jonathan Turner Eagles
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: