Sqoop
  1. Sqoop
  2. SQOOP-358

Sqoop import fails on netezza nvarchar datatype with --as-avrodatafile

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.0-incubating
    • Fix Version/s: 1.4.0-incubating
    • Component/s: None
    • Labels:

      Description

      Using --as-avrodatafile causes sqoop to error on nvarchar fields as well as presumably longnvarchars. This is the same bug as SQOOP-323 except with the avro export turned on.

      1. SQOOP-358.patch
        0.5 kB
        Chris Tierney

        Activity

        Hide
        Chris Tierney added a comment - - edited

        added to AvroSchemaGenerator. this is my first Apache patch so apologies if I am doing something wrong. It seems that this logic appears in the app in a few different places, should these be combined into a single static method that is shared among the different clients of that code?

        Show
        Chris Tierney added a comment - - edited added to AvroSchemaGenerator. this is my first Apache patch so apologies if I am doing something wrong. It seems that this logic appears in the app in a few different places, should these be combined into a single static method that is shared among the different clients of that code?
        Hide
        Bilung Lee added a comment -

        Thanks for contributing, Chris! Yes, in general it would be nice to consolidate repeating code into a utility class. What are the other places you are referring to though?

        Show
        Bilung Lee added a comment - Thanks for contributing, Chris! Yes, in general it would be nice to consolidate repeating code into a utility class. What are the other places you are referring to though?
        Hide
        Chris Tierney added a comment -

        Oh whoops, I was thinking that the case statements that were edited in SQOOP-323 were doing the same thing, but they are not.

        Show
        Chris Tierney added a comment - Oh whoops, I was thinking that the case statements that were edited in SQOOP-323 were doing the same thing, but they are not.
        Hide
        Chris Tierney added a comment -

        Please let me know if there is anything else I can do get this accepted. Thanks!

        Show
        Chris Tierney added a comment - Please let me know if there is anything else I can do get this accepted. Thanks!
        Hide
        Bilung Lee added a comment -

        Patch committed. Thanks, Chris!

        Show
        Bilung Lee added a comment - Patch committed. Thanks, Chris!
        Hide
        Hudson added a comment -

        Integrated in Sqoop-jdk-1.6 #37 (See https://builds.apache.org/job/Sqoop-jdk-1.6/37/)
        SQOOP-358 Sqoop import fails on netezza nvarchar datatype with --as-avrodatafile

        (Chris Tierney via Bilung Lee)

        blee : http://svn.apache.org/viewvc/?view=rev&rev=1182150
        Files :

        • /incubator/sqoop/trunk/src/java/com/cloudera/sqoop/orm/AvroSchemaGenerator.java
        Show
        Hudson added a comment - Integrated in Sqoop-jdk-1.6 #37 (See https://builds.apache.org/job/Sqoop-jdk-1.6/37/ ) SQOOP-358 Sqoop import fails on netezza nvarchar datatype with --as-avrodatafile (Chris Tierney via Bilung Lee) blee : http://svn.apache.org/viewvc/?view=rev&rev=1182150 Files : /incubator/sqoop/trunk/src/java/com/cloudera/sqoop/orm/AvroSchemaGenerator.java

          People

          • Assignee:
            Chris Tierney
            Reporter:
            Chris Tierney
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development