Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.6
    • Fix Version/s: 1.4.7
    • Component/s: None
    • Labels:
      None

      Description

      I found out that --query doesn't work with --as-parquetfile parameter and it fails on NullPointerException:

      15/09/17 10:17:28 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerException
      java.lang.NullPointerException
              at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:97)
              at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478)
              at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
              at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
              at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
              at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
              at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
              at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
              at org.apache.sqoop.Sqoop.main(Sqoop.java:236)
      

      It seems that the problem is introduced by SQOOP-2294 as we made table-import only change.

      1. SQOOP-2582.patch
        3 kB
        Jarek Jarcec Cecho

        Issue Links

          Activity

          Hide
          hshreedharan Hari Shreedharan added a comment -

          +1. Committing

          Show
          hshreedharan Hari Shreedharan added a comment - +1. Committing
          Hide
          jira-bot ASF subversion and git services added a comment -

          Commit ae9ab0fa37efb405b349e2c91050479ef4355526 in sqoop's branch refs/heads/trunk from Hari Shreedharan
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=ae9ab0f ]

          SQOOP-2582. Query import won't work for parquet

          (Jarcec via Hari)

          Show
          jira-bot ASF subversion and git services added a comment - Commit ae9ab0fa37efb405b349e2c91050479ef4355526 in sqoop's branch refs/heads/trunk from Hari Shreedharan [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=ae9ab0f ] SQOOP-2582 . Query import won't work for parquet (Jarcec via Hari)
          Hide
          hshreedharan Hari Shreedharan added a comment -

          Committed! Thanks Jarcec!

          Show
          hshreedharan Hari Shreedharan added a comment - Committed! Thanks Jarcec!
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Sqoop-hadoop200 #1023 (See https://builds.apache.org/job/Sqoop-hadoop200/1023/)
          SQOOP-2582. Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526)

          • src/java/org/apache/sqoop/tool/CodeGenTool.java
          • src/test/com/cloudera/sqoop/TestParquetImport.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Sqoop-hadoop200 #1023 (See https://builds.apache.org/job/Sqoop-hadoop200/1023/ ) SQOOP-2582 . Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526 ) src/java/org/apache/sqoop/tool/CodeGenTool.java src/test/com/cloudera/sqoop/TestParquetImport.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Sqoop-hadoop20 #1016 (See https://builds.apache.org/job/Sqoop-hadoop20/1016/)
          SQOOP-2582. Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526)

          • src/test/com/cloudera/sqoop/TestParquetImport.java
          • src/java/org/apache/sqoop/tool/CodeGenTool.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Sqoop-hadoop20 #1016 (See https://builds.apache.org/job/Sqoop-hadoop20/1016/ ) SQOOP-2582 . Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526 ) src/test/com/cloudera/sqoop/TestParquetImport.java src/java/org/apache/sqoop/tool/CodeGenTool.java
          Hide
          hudson Hudson added a comment -

          SUCCESS: Integrated in Sqoop-hadoop100 #983 (See https://builds.apache.org/job/Sqoop-hadoop100/983/)
          SQOOP-2582. Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526)

          • src/java/org/apache/sqoop/tool/CodeGenTool.java
          • src/test/com/cloudera/sqoop/TestParquetImport.java
          Show
          hudson Hudson added a comment - SUCCESS: Integrated in Sqoop-hadoop100 #983 (See https://builds.apache.org/job/Sqoop-hadoop100/983/ ) SQOOP-2582 . Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526 ) src/java/org/apache/sqoop/tool/CodeGenTool.java src/test/com/cloudera/sqoop/TestParquetImport.java
          Hide
          hudson Hudson added a comment -

          FAILURE: Integrated in Sqoop-hadoop23 #1219 (See https://builds.apache.org/job/Sqoop-hadoop23/1219/)
          SQOOP-2582. Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526)

          • src/test/com/cloudera/sqoop/TestParquetImport.java
          • src/java/org/apache/sqoop/tool/CodeGenTool.java
          Show
          hudson Hudson added a comment - FAILURE: Integrated in Sqoop-hadoop23 #1219 (See https://builds.apache.org/job/Sqoop-hadoop23/1219/ ) SQOOP-2582 . Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526 ) src/test/com/cloudera/sqoop/TestParquetImport.java src/java/org/apache/sqoop/tool/CodeGenTool.java

            People

            • Assignee:
              jarcec Jarek Jarcec Cecho
              Reporter:
              jarcec Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development