Details

    • Type: Test Test
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.3
    • Fix Version/s: 1.4.4
    • Component/s: connectors/sqlserver
    • Labels:
      None

      Description

      Add the MS Sqoop connector tests that test integration scenarios with SQL Server to the repo.

      1. SQOOP-1035.7.patch
        153 kB
        Shuaishuai Nie
      2. SQOOP-1035.6.patch
        156 kB
        Shuaishuai Nie
      3. SQOOP-1035.5.patch
        158 kB
        Shuaishuai Nie
      4. SQOOP-1035.4.patch
        154 kB
        Shuaishuai Nie
      5. SQOOP-1035.3.patch
        152 kB
        Shuaishuai Nie
      6. SQOOP-1035.2.patch
        151 kB
        Shuaishuai Nie
      7. SQOOP-1035.1.patch
        155 kB
        Shuaishuai Nie

        Issue Links

          Activity

          Hide
          Shuaishuai Nie added a comment -

          To run the manual tests for the MS Sqoop Connecter in the patch, just set the corresponding properties in the sqoop/conf/MSTest.properties file and set the "sqoop.test.sqlserver.connectstring.host_url" property in the build.xml from the default one to the SQL Server being used

          Show
          Shuaishuai Nie added a comment - To run the manual tests for the MS Sqoop Connecter in the patch, just set the corresponding properties in the sqoop/conf/MSTest.properties file and set the "sqoop.test.sqlserver.connectstring.host_url" property in the build.xml from the default one to the SQL Server being used
          Hide
          Jarek Jarcec Cecho added a comment -

          Hi Shuaishuai Nie, thank you very much for working on this JIRA! It seems that your patch is quite big, so would you mind uploading it to review board?

          Show
          Jarek Jarcec Cecho added a comment - Hi Shuaishuai Nie , thank you very much for working on this JIRA! It seems that your patch is quite big, so would you mind uploading it to review board ?
          Hide
          Shuaishuai Nie added a comment -

          Thanks Jarek. The review is available here https://reviews.apache.org/r/10987/

          Show
          Shuaishuai Nie added a comment - Thanks Jarek. The review is available here https://reviews.apache.org/r/10987/
          Hide
          Shuaishuai Nie added a comment -

          Update exception handling during setup and teardown of the tests

          Show
          Shuaishuai Nie added a comment - Update exception handling during setup and teardown of the tests
          Hide
          Jarek Jarcec Cecho added a comment -

          Assigning to Shuaishuai Nie.

          Show
          Jarek Jarcec Cecho added a comment - Assigning to Shuaishuai Nie .
          Hide
          Shuaishuai Nie added a comment -

          Improve logging for all the SQL integration tests

          Show
          Shuaishuai Nie added a comment - Improve logging for all the SQL integration tests
          Hide
          Venkat Ranganathan added a comment -

          I am getting this error when applying your patch to trunk on Mac/Windows/Linux

          $ git apply ~/Downloads/SQOOP-1035.5.patch
          error: test/com/cloudera/sqoop/hive/TestHiveImport.java: No such file or directory
          error: test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java: No such file or directory

          How did you generate the patch?

          Show
          Venkat Ranganathan added a comment - I am getting this error when applying your patch to trunk on Mac/Windows/Linux $ git apply ~/Downloads/ SQOOP-1035 .5.patch error: test/com/cloudera/sqoop/hive/TestHiveImport.java: No such file or directory error: test/com/cloudera/sqoop/manager/SQLServerManagerImportManualTest.java: No such file or directory How did you generate the patch?
          Hide
          Venkat Ranganathan added a comment -

          OK, I finally got around with explicitly specifying -p0 to apply.

          Show
          Venkat Ranganathan added a comment - OK, I finally got around with explicitly specifying -p0 to apply.
          Hide
          ASF subversion and git services added a comment -

          Commit 64878c643e5c9cef77e6c74b8392df17b72e7096 in branch refs/heads/trunk from Jarek Jarcec Cecho
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=64878c6 ]

          SQOOP-1035: Add MS Sqoop Connecter tests

          (Shuaishuai Nie via Jarek Jarcec Cecho)

          Show
          ASF subversion and git services added a comment - Commit 64878c643e5c9cef77e6c74b8392df17b72e7096 in branch refs/heads/trunk from Jarek Jarcec Cecho [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=64878c6 ] SQOOP-1035 : Add MS Sqoop Connecter tests (Shuaishuai Nie via Jarek Jarcec Cecho)
          Hide
          Jarek Jarcec Cecho added a comment -

          Thank you Shuaishuai for your great contribution!

          Show
          Jarek Jarcec Cecho added a comment - Thank you Shuaishuai for your great contribution!
          Hide
          Shuaishuai Nie added a comment -

          Thanks Jarek!

          Show
          Shuaishuai Nie added a comment - Thanks Jarek!
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop23 #932 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/932/)
          SQOOP-1035: Add MS Sqoop Connecter tests (Revision 64878c643e5c9cef77e6c74b8392df17b72e7096)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=64878c643e5c9cef77e6c74b8392df17b72e7096
          Files :

          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportDelimitedFileManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerWhereManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestData.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerSplitByManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiMapsManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportSequenceFileManualTest.java
          • testdata/DatatypeTestData-export-lite.txt
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportDelimitedFileManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestDataFileParser.java
          • src/test/com/cloudera/sqoop/hive/TestHiveImport.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportSequenceFileManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerManagerManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerQueryManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerParseMethodsManualTest.java
          • testdata/DatatypeTestData-import-lite.txt
          • src/test/com/cloudera/sqoop/ThirdPartyTests.java
          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestUtils.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerHiveImportManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiColsManualTest.java
          • build.xml
          • src/test/org/apache/sqoop/manager/sqlserver/ManagerCompatExport.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop23 #932 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/932/ ) SQOOP-1035 : Add MS Sqoop Connecter tests (Revision 64878c643e5c9cef77e6c74b8392df17b72e7096) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=64878c643e5c9cef77e6c74b8392df17b72e7096 Files : src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportDelimitedFileManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerWhereManualTest.java src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestData.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerSplitByManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiMapsManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportSequenceFileManualTest.java testdata/DatatypeTestData-export-lite.txt src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportDelimitedFileManualTest.java src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestDataFileParser.java src/test/com/cloudera/sqoop/hive/TestHiveImport.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportSequenceFileManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerManagerManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerQueryManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerParseMethodsManualTest.java testdata/DatatypeTestData-import-lite.txt src/test/com/cloudera/sqoop/ThirdPartyTests.java src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestUtils.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerHiveImportManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiColsManualTest.java build.xml src/test/org/apache/sqoop/manager/sqlserver/ManagerCompatExport.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop20 #737 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/737/)
          SQOOP-1035: Add MS Sqoop Connecter tests (Revision 64878c643e5c9cef77e6c74b8392df17b72e7096)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=64878c643e5c9cef77e6c74b8392df17b72e7096
          Files :

          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestDataFileParser.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerParseMethodsManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportDelimitedFileManualTest.java
          • build.xml
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerHiveImportManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerSplitByManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerManagerManualTest.java
          • src/test/com/cloudera/sqoop/ThirdPartyTests.java
          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestData.java
          • src/test/com/cloudera/sqoop/hive/TestHiveImport.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerWhereManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiColsManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/ManagerCompatExport.java
          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestUtils.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportDelimitedFileManualTest.java
          • testdata/DatatypeTestData-import-lite.txt
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerQueryManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportSequenceFileManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiMapsManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportSequenceFileManualTest.java
          • testdata/DatatypeTestData-export-lite.txt
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop20 #737 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/737/ ) SQOOP-1035 : Add MS Sqoop Connecter tests (Revision 64878c643e5c9cef77e6c74b8392df17b72e7096) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=64878c643e5c9cef77e6c74b8392df17b72e7096 Files : src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestDataFileParser.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerParseMethodsManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportDelimitedFileManualTest.java build.xml src/test/org/apache/sqoop/manager/sqlserver/SQLServerHiveImportManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerSplitByManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerManagerManualTest.java src/test/com/cloudera/sqoop/ThirdPartyTests.java src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestData.java src/test/com/cloudera/sqoop/hive/TestHiveImport.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerWhereManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiColsManualTest.java src/test/org/apache/sqoop/manager/sqlserver/ManagerCompatExport.java src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestUtils.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportDelimitedFileManualTest.java testdata/DatatypeTestData-import-lite.txt src/test/org/apache/sqoop/manager/sqlserver/SQLServerQueryManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportSequenceFileManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiMapsManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportSequenceFileManualTest.java testdata/DatatypeTestData-export-lite.txt
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop200 #749 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/749/)
          SQOOP-1035: Add MS Sqoop Connecter tests (Revision 64878c643e5c9cef77e6c74b8392df17b72e7096)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=64878c643e5c9cef77e6c74b8392df17b72e7096
          Files :

          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerQueryManualTest.java
          • build.xml
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerHiveImportManualTest.java
          • testdata/DatatypeTestData-export-lite.txt
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerParseMethodsManualTest.java
          • testdata/DatatypeTestData-import-lite.txt
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerManagerManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiMapsManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportSequenceFileManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestUtils.java
          • src/test/com/cloudera/sqoop/ThirdPartyTests.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerWhereManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportDelimitedFileManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportSequenceFileManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportDelimitedFileManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/ManagerCompatExport.java
          • src/test/com/cloudera/sqoop/hive/TestHiveImport.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerSplitByManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestData.java
          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestDataFileParser.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiColsManualTest.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop200 #749 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/749/ ) SQOOP-1035 : Add MS Sqoop Connecter tests (Revision 64878c643e5c9cef77e6c74b8392df17b72e7096) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=64878c643e5c9cef77e6c74b8392df17b72e7096 Files : src/test/org/apache/sqoop/manager/sqlserver/SQLServerQueryManualTest.java build.xml src/test/org/apache/sqoop/manager/sqlserver/SQLServerHiveImportManualTest.java testdata/DatatypeTestData-export-lite.txt src/test/org/apache/sqoop/manager/sqlserver/SQLServerParseMethodsManualTest.java testdata/DatatypeTestData-import-lite.txt src/test/org/apache/sqoop/manager/sqlserver/SQLServerManagerManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiMapsManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportSequenceFileManualTest.java src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestUtils.java src/test/com/cloudera/sqoop/ThirdPartyTests.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerWhereManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportDelimitedFileManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportSequenceFileManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportDelimitedFileManualTest.java src/test/org/apache/sqoop/manager/sqlserver/ManagerCompatExport.java src/test/com/cloudera/sqoop/hive/TestHiveImport.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerSplitByManualTest.java src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestData.java src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestDataFileParser.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiColsManualTest.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop100 #712 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/712/)
          SQOOP-1035: Add MS Sqoop Connecter tests (Revision 64878c643e5c9cef77e6c74b8392df17b72e7096)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=64878c643e5c9cef77e6c74b8392df17b72e7096
          Files :

          • testdata/DatatypeTestData-import-lite.txt
          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestDataFileParser.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerSplitByManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestUtils.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportSequenceFileManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerManagerManualTest.java
          • src/test/com/cloudera/sqoop/ThirdPartyTests.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerHiveImportManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerParseMethodsManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerWhereManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiColsManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportSequenceFileManualTest.java
          • build.xml
          • src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestData.java
          • src/test/org/apache/sqoop/manager/sqlserver/ManagerCompatExport.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportDelimitedFileManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiMapsManualTest.java
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerQueryManualTest.java
          • src/test/com/cloudera/sqoop/hive/TestHiveImport.java
          • testdata/DatatypeTestData-export-lite.txt
          • src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportDelimitedFileManualTest.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop100 #712 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/712/ ) SQOOP-1035 : Add MS Sqoop Connecter tests (Revision 64878c643e5c9cef77e6c74b8392df17b72e7096) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=64878c643e5c9cef77e6c74b8392df17b72e7096 Files : testdata/DatatypeTestData-import-lite.txt src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestDataFileParser.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerSplitByManualTest.java src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestUtils.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportSequenceFileManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerManagerManualTest.java src/test/com/cloudera/sqoop/ThirdPartyTests.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerHiveImportManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerParseMethodsManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerWhereManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiColsManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportSequenceFileManualTest.java build.xml src/test/org/apache/sqoop/manager/sqlserver/MSSQLTestData.java src/test/org/apache/sqoop/manager/sqlserver/ManagerCompatExport.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeImportDelimitedFileManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerMultiMapsManualTest.java src/test/org/apache/sqoop/manager/sqlserver/SQLServerQueryManualTest.java src/test/com/cloudera/sqoop/hive/TestHiveImport.java testdata/DatatypeTestData-export-lite.txt src/test/org/apache/sqoop/manager/sqlserver/SQLServerDatatypeExportDelimitedFileManualTest.java

            People

            • Assignee:
              Shuaishuai Nie
              Reporter:
              Shuaishuai Nie
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development