Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-1053

Fix sqoop to work with Hadoop 2.0.4 alpha

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.3
    • 1.4.4
    • test
    • None
    • Hadoop 2.0.4

    Description

      I updated the build and ivy settings to build Sqoop with Hadoop 2.0.4 alpha.

      One of the compression tests (testBzip2TextCompression) fails with the following stack trace

      Testcase: testBzip2TextCompression took 1.21 sec
      Caused an ERROR
      null
      java.lang.NullPointerException
      at org.apache.hadoop.io.compress.bzip2.Bzip2Factory.isNativeBzip2Loaded(Bzip2Factory.java:54)
      at org.apache.hadoop.io.compress.bzip2.Bzip2Factory.getBzip2Decompressor(Bzip2Factory.java:123)
      at org.apache.hadoop.io.compress.BZip2Codec.createDecompressor(BZip2Codec.java:250)
      at org.apache.hadoop.io.compress.BZip2Codec.createInputStream(BZip2Codec.java:156)
      at com.cloudera.sqoop.TestCompression.runTextCompressionTest(TestCompression.java:170)
      at com.cloudera.sqoop.TestCompression.testBzip2TextCompression(TestCompression.java:189)

      The reason is in 2.0.4, with native BZip2 codec, the configuration is checked and we don't do setConf for BZip2 codec. Fixed the test to set the configuration irrespective of whether it was passed in or we created the codec.

      Attachments

        1. SQOOP-1053.diff.2
          1 kB
          Venkat Ranganathan

        Issue Links

          Activity

            People

              venkatnrangan Venkat Ranganathan
              venkatnrangan Venkat Ranganathan
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Slack

                  Issue deployment