Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-358

Sqoop import fails on netezza nvarchar datatype with --as-avrodatafile

        Details

        • Type: Bug
        • Status: Resolved
        • Priority: Major
        • Resolution: Fixed
        • Affects Version/s: 1.4.0-incubating
        • Fix Version/s: 1.4.0-incubating
        • Component/s: None
        • Labels:

          Description

          Using --as-avrodatafile causes sqoop to error on nvarchar fields as well as presumably longnvarchars. This is the same bug as SQOOP-323 except with the avro export turned on.

          1. Text File
            SQOOP-358.patch
            0.5 kB
            Chris Tierney

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            ctierney Chris Tierney added a comment - - edited

            added to AvroSchemaGenerator. this is my first Apache patch so apologies if I am doing something wrong. It seems that this logic appears in the app in a few different places, should these be combined into a single static method that is shared among the different clients of that code?

            Show
            ctierney Chris Tierney added a comment - - edited added to AvroSchemaGenerator. this is my first Apache patch so apologies if I am doing something wrong. It seems that this logic appears in the app in a few different places, should these be combined into a single static method that is shared among the different clients of that code?
            Hide
            Permalink
            bleeapache Bilung Lee added a comment -

            Thanks for contributing, Chris! Yes, in general it would be nice to consolidate repeating code into a utility class. What are the other places you are referring to though?

            Show
            bleeapache Bilung Lee added a comment - Thanks for contributing, Chris! Yes, in general it would be nice to consolidate repeating code into a utility class. What are the other places you are referring to though?
            Hide
            Permalink
            ctierney Chris Tierney added a comment -

            Oh whoops, I was thinking that the case statements that were edited in SQOOP-323 were doing the same thing, but they are not.

            Show
            ctierney Chris Tierney added a comment - Oh whoops, I was thinking that the case statements that were edited in SQOOP-323 were doing the same thing, but they are not.
            Hide
            Permalink
            ctierney Chris Tierney added a comment -

            Please let me know if there is anything else I can do get this accepted. Thanks!

            Show
            ctierney Chris Tierney added a comment - Please let me know if there is anything else I can do get this accepted. Thanks!
            Hide
            Permalink
            bleeapache Bilung Lee added a comment -

            Patch committed. Thanks, Chris!

            Show
            bleeapache Bilung Lee added a comment - Patch committed. Thanks, Chris!
            Hide
            Permalink
            hudson Hudson added a comment -

            Integrated in Sqoop-jdk-1.6 #37 (See https://builds.apache.org/job/Sqoop-jdk-1.6/37/)
            SQOOP-358 Sqoop import fails on netezza nvarchar datatype with --as-avrodatafile

            (Chris Tierney via Bilung Lee)

            blee : http://svn.apache.org/viewvc/?view=rev&rev=1182150
            Files :

            • /incubator/sqoop/trunk/src/java/com/cloudera/sqoop/orm/AvroSchemaGenerator.java
            Show
            hudson Hudson added a comment - Integrated in Sqoop-jdk-1.6 #37 (See https://builds.apache.org/job/Sqoop-jdk-1.6/37/ ) SQOOP-358 Sqoop import fails on netezza nvarchar datatype with --as-avrodatafile (Chris Tierney via Bilung Lee) blee : http://svn.apache.org/viewvc/?view=rev&rev=1182150 Files : /incubator/sqoop/trunk/src/java/com/cloudera/sqoop/orm/AvroSchemaGenerator.java

              People

              • Assignee:
                ctierney Chris Tierney
                Reporter:
                ctierney Chris Tierney
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Development