Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1327

Oracle database import via sqoop fails when a table contains the column types such as TIMESTAMP(6) WITH LOCAL TIME ZONE and TIMESTAMP(6) WITH TIME ZONE

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 0.22.0
    • None
    • None
    • None
    • Reviewed

    Description

      When Oracle table contains the columns "TIMESTAMP(6) WITH LOCAL TIME ZONE" and "TIMESTAMP(6) WITH TIME ZONE", Sqoop fails to map values for those columns to valid Java data types, resulting in the following exception:

      ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerException
      java.lang.NullPointerException
      at org.apache.hadoop.sqoop.orm.ClassWriter.generateFields(ClassWriter.java:253)
      at org.apache.hadoop.sqoop.orm.ClassWriter.generateClassForColumns(ClassWriter.java:701)
      at org.apache.hadoop.sqoop.orm.ClassWriter.generate(ClassWriter.java:597)
      at org.apache.hadoop.sqoop.Sqoop.generateORM(Sqoop.java:75)
      at org.apache.hadoop.sqoop.Sqoop.importTable(Sqoop.java:87)
      at org.apache.hadoop.sqoop.Sqoop.run(Sqoop.java:175)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:79)
      at org.apache.hadoop.sqoop.Sqoop.main(Sqoop.java:201)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)

      I have modified the code for Hadoop and Sqoop so this bug is fixed on my machine. Please let me know if you would like me to generate the patch and upload it to this ticket.

      Attachments

        1. MAPREDUCE-1327.3.patch
          18 kB
          Leonid Furman
        2. MAPREDUCE-1327.4.patch
          22 kB
          Leonid Furman
        3. MAPREDUCE-1327.5.patch
          22 kB
          Leonid Furman
        4. MAPREDUCE-1327.patch
          19 kB
          Leonid Furman

        Activity

          People

            lfurman Leonid Furman
            lfurman Leonid Furman
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - 96h
                96h
                Remaining:
                Remaining Estimate - 96h
                96h
                Logged:
                Time Spent - Not Specified
                Not Specified