Sqoop
  1. Sqoop
  2. SQOOP-540

Microsoft SQL Connector doesn't support custom schemas

    Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.1-incubating, 1.4.2
    • Fix Version/s: 1.4.3
    • Component/s: connectors/sqlserver
    • Labels:
      None

      Description

      Trying list-tables on the Microsoft test db AdventureWorks2008R2, Sqoop lists only the tables of the dbo (default) schema.
      Trying to import a table which belongs to a schema different from dbo, it fails with the message Invalid object name.

      1. SQOOP-540.patch
        22 kB
        Jarek Jarcec Cecho

        Issue Links

          Activity

          Hide
          Giovanni Ruggiero added a comment -

          This issue happens also in the 1.4.2 version.
          There are any plans to check this bug?

          Thank you

          Show
          Giovanni Ruggiero added a comment - This issue happens also in the 1.4.2 version. There are any plans to check this bug? Thank you
          Hide
          Jarek Jarcec Cecho added a comment -

          Hi Giovanni,
          I've recently added support for schemas into PostgreSQL connector, so I'll take a look on this issue as well.

          Jarcec

          Show
          Jarek Jarcec Cecho added a comment - Hi Giovanni, I've recently added support for schemas into PostgreSQL connector, so I'll take a look on this issue as well. Jarcec
          Hide
          Cheolsoo Park added a comment -

          Committed to trunk. Thanks, Jarcec!

          Show
          Cheolsoo Park added a comment - Committed to trunk. Thanks, Jarcec!
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop200 #138 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/138/)
          SQOOP-540 Microsoft SQL Connector doesn't support custom schemas (Revision 4a26d0905ce58e97a35494dbd425f768b34abe28)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=4a26d0905ce58e97a35494dbd425f768b34abe28
          Files :

          • src/java/org/apache/sqoop/manager/SQLServerManager.java
          • src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java
          • src/test/com/cloudera/sqoop/manager/SQLServerManagerExportManualTest.java
          • src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java
          • src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop200 #138 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/138/ ) SQOOP-540 Microsoft SQL Connector doesn't support custom schemas (Revision 4a26d0905ce58e97a35494dbd425f768b34abe28) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=4a26d0905ce58e97a35494dbd425f768b34abe28 Files : src/java/org/apache/sqoop/manager/SQLServerManager.java src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java src/test/com/cloudera/sqoop/manager/SQLServerManagerExportManualTest.java src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop20 #139 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/139/)
          SQOOP-540 Microsoft SQL Connector doesn't support custom schemas (Revision 4a26d0905ce58e97a35494dbd425f768b34abe28)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=4a26d0905ce58e97a35494dbd425f768b34abe28
          Files :

          • src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java
          • src/test/com/cloudera/sqoop/manager/SQLServerManagerExportManualTest.java
          • src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java
          • src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java
          • src/java/org/apache/sqoop/manager/SQLServerManager.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop20 #139 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/139/ ) SQOOP-540 Microsoft SQL Connector doesn't support custom schemas (Revision 4a26d0905ce58e97a35494dbd425f768b34abe28) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=4a26d0905ce58e97a35494dbd425f768b34abe28 Files : src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java src/test/com/cloudera/sqoop/manager/SQLServerManagerExportManualTest.java src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java src/java/org/apache/sqoop/manager/SQLServerManager.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop23 #280 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/280/)
          SQOOP-540 Microsoft SQL Connector doesn't support custom schemas (Revision 4a26d0905ce58e97a35494dbd425f768b34abe28)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=4a26d0905ce58e97a35494dbd425f768b34abe28
          Files :

          • src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java
          • src/test/com/cloudera/sqoop/manager/SQLServerManagerExportManualTest.java
          • src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java
          • src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java
          • src/java/org/apache/sqoop/manager/SQLServerManager.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop23 #280 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/280/ ) SQOOP-540 Microsoft SQL Connector doesn't support custom schemas (Revision 4a26d0905ce58e97a35494dbd425f768b34abe28) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=4a26d0905ce58e97a35494dbd425f768b34abe28 Files : src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java src/test/com/cloudera/sqoop/manager/SQLServerManagerExportManualTest.java src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java src/java/org/apache/sqoop/manager/SQLServerManager.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop100 #145 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/145/)
          SQOOP-540 Microsoft SQL Connector doesn't support custom schemas (Revision 4a26d0905ce58e97a35494dbd425f768b34abe28)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=4a26d0905ce58e97a35494dbd425f768b34abe28
          Files :

          • src/test/com/cloudera/sqoop/manager/SQLServerManagerExportManualTest.java
          • src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java
          • src/java/org/apache/sqoop/manager/SQLServerManager.java
          • src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java
          • src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop100 #145 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/145/ ) SQOOP-540 Microsoft SQL Connector doesn't support custom schemas (Revision 4a26d0905ce58e97a35494dbd425f768b34abe28) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=4a26d0905ce58e97a35494dbd425f768b34abe28 Files : src/test/com/cloudera/sqoop/manager/SQLServerManagerExportManualTest.java src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java src/java/org/apache/sqoop/manager/SQLServerManager.java src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java
          Hide
          sam liu added a comment -

          Hi,

          I tried to apply attached patch on my local 1.4.1-incubating, but it failed. The error message has been shown as below. Is there any expert help me? Thanks a lot!

          error: patch failed: src/java/org/apache/sqoop/manager/SQLServerManager.java:75
          error: src/java/org/apache/sqoop/manager/SQLServerManager.java: patch does not apply
          error: patch failed: src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java:175
          error: src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java: patch does not apply
          error: patch failed: src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java:99
          error: src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java: patch does not apply
          error: patch failed: src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java:179
          error: src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java: patch does not apply

          Show
          sam liu added a comment - Hi, I tried to apply attached patch on my local 1.4.1-incubating, but it failed. The error message has been shown as below. Is there any expert help me? Thanks a lot! error: patch failed: src/java/org/apache/sqoop/manager/SQLServerManager.java:75 error: src/java/org/apache/sqoop/manager/SQLServerManager.java: patch does not apply error: patch failed: src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java:175 error: src/java/org/apache/sqoop/mapreduce/HBaseImportJob.java: patch does not apply error: patch failed: src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java:99 error: src/java/org/apache/sqoop/mapreduce/db/DataDrivenDBRecordReader.java: patch does not apply error: patch failed: src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java:179 error: src/test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java: patch does not apply
          Hide
          Jarek Jarcec Cecho added a comment -

          Hi Sam,
          1.4.1-incubating is quite old release. It might simply happened that the underlying files has been changed and thus the patch is not applying cleanly. The patch is already committed, so you might simply build trunk in order to get build with this patch.

          Jarcec

          Show
          Jarek Jarcec Cecho added a comment - Hi Sam, 1.4.1-incubating is quite old release. It might simply happened that the underlying files has been changed and thus the patch is not applying cleanly. The patch is already committed, so you might simply build trunk in order to get build with this patch. Jarcec

            People

            • Assignee:
              Jarek Jarcec Cecho
              Reporter:
              Giovanni Ruggiero
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development