Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-2582

Query import won't work for parquet

        Details

        • Type: Bug
        • Status: Resolved
        • Priority: Major
        • Resolution: Fixed
        • Affects Version/s: 1.4.6
        • Fix Version/s: 1.4.7
        • Component/s: None
        • Labels:
          None

          Description

          I found out that --query doesn't work with --as-parquetfile parameter and it fails on NullPointerException:

          15/09/17 10:17:28 ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.NullPointerException
java.lang.NullPointerException
        at org.apache.sqoop.tool.CodeGenTool.generateORM(CodeGenTool.java:97)
        at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:478)
        at org.apache.sqoop.tool.ImportTool.run(ImportTool.java:605)
        at org.apache.sqoop.Sqoop.run(Sqoop.java:143)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
        at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:179)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:218)
        at org.apache.sqoop.Sqoop.runTool(Sqoop.java:227)
        at org.apache.sqoop.Sqoop.main(Sqoop.java:236)

          It seems that the problem is introduced by SQOOP-2294 as we made table-import only change.

          1. Text File
            SQOOP-2582.patch
            3 kB
            Jarek Jarcec Cecho

            Issue Links

            links to

            Web Link Review board

              Activity

              Ascending order - Click to sort in descending order
              Hide
              Permalink
              hshreedharan Hari Shreedharan added a comment -

              +1. Committing

              Show
              hshreedharan Hari Shreedharan added a comment - +1. Committing
              Hide
              Permalink
              jira-bot ASF subversion and git services added a comment -

              Commit ae9ab0fa37efb405b349e2c91050479ef4355526 in sqoop's branch refs/heads/trunk from Hari Shreedharan
              [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=ae9ab0f ]

              SQOOP-2582. Query import won't work for parquet

              (Jarcec via Hari)

              Show
              jira-bot ASF subversion and git services added a comment - Commit ae9ab0fa37efb405b349e2c91050479ef4355526 in sqoop's branch refs/heads/trunk from Hari Shreedharan [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=ae9ab0f ] SQOOP-2582 . Query import won't work for parquet (Jarcec via Hari)
              Hide
              Permalink
              hshreedharan Hari Shreedharan added a comment -

              Committed! Thanks Jarcec!

              Show
              hshreedharan Hari Shreedharan added a comment - Committed! Thanks Jarcec!
              Hide
              Permalink
              hudson Hudson added a comment -

              SUCCESS: Integrated in Sqoop-hadoop200 #1023 (See https://builds.apache.org/job/Sqoop-hadoop200/1023/)
              SQOOP-2582. Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526)

              • src/java/org/apache/sqoop/tool/CodeGenTool.java
              • src/test/com/cloudera/sqoop/TestParquetImport.java
              Show
              hudson Hudson added a comment - SUCCESS: Integrated in Sqoop-hadoop200 #1023 (See https://builds.apache.org/job/Sqoop-hadoop200/1023/ ) SQOOP-2582 . Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526 ) src/java/org/apache/sqoop/tool/CodeGenTool.java src/test/com/cloudera/sqoop/TestParquetImport.java
              Hide
              Permalink
              hudson Hudson added a comment -

              FAILURE: Integrated in Sqoop-hadoop20 #1016 (See https://builds.apache.org/job/Sqoop-hadoop20/1016/)
              SQOOP-2582. Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526)

              • src/test/com/cloudera/sqoop/TestParquetImport.java
              • src/java/org/apache/sqoop/tool/CodeGenTool.java
              Show
              hudson Hudson added a comment - FAILURE: Integrated in Sqoop-hadoop20 #1016 (See https://builds.apache.org/job/Sqoop-hadoop20/1016/ ) SQOOP-2582 . Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526 ) src/test/com/cloudera/sqoop/TestParquetImport.java src/java/org/apache/sqoop/tool/CodeGenTool.java
              Hide
              Permalink
              hudson Hudson added a comment -

              SUCCESS: Integrated in Sqoop-hadoop100 #983 (See https://builds.apache.org/job/Sqoop-hadoop100/983/)
              SQOOP-2582. Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526)

              • src/java/org/apache/sqoop/tool/CodeGenTool.java
              • src/test/com/cloudera/sqoop/TestParquetImport.java
              Show
              hudson Hudson added a comment - SUCCESS: Integrated in Sqoop-hadoop100 #983 (See https://builds.apache.org/job/Sqoop-hadoop100/983/ ) SQOOP-2582 . Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526 ) src/java/org/apache/sqoop/tool/CodeGenTool.java src/test/com/cloudera/sqoop/TestParquetImport.java
              Hide
              Permalink
              hudson Hudson added a comment -

              FAILURE: Integrated in Sqoop-hadoop23 #1219 (See https://builds.apache.org/job/Sqoop-hadoop23/1219/)
              SQOOP-2582. Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526)

              • src/test/com/cloudera/sqoop/TestParquetImport.java
              • src/java/org/apache/sqoop/tool/CodeGenTool.java
              Show
              hudson Hudson added a comment - FAILURE: Integrated in Sqoop-hadoop23 #1219 (See https://builds.apache.org/job/Sqoop-hadoop23/1219/ ) SQOOP-2582 . Query import won't work for parquet (hshreedharan: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=ae9ab0fa37efb405b349e2c91050479ef4355526 ) src/test/com/cloudera/sqoop/TestParquetImport.java src/java/org/apache/sqoop/tool/CodeGenTool.java

                People

                • Assignee:
                  jarcec Jarek Jarcec Cecho
                  Reporter:
                  jarcec Jarek Jarcec Cecho
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  6 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development