Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 2.0.0
    • Component/s: None
    • Labels:
      None

      Description

      Create a MySQL "Fast" connector using mysqldump and mysqlimport utilities.

      1. SQOOP-1859.0.patch
        91 kB
        Abraham Elmahrek
      2. SQOOP-1859.1.patch
        88 kB
        Abraham Elmahrek
      3. SQOOP-1859.2.patch
        113 kB
        Abraham Elmahrek
      4. SQOOP-1859.3.patch
        114 kB
        Abraham Elmahrek
      5. SQOOP-1859.5.patch
        115 kB
        Abraham Elmahrek

        Issue Links

          Activity

          Hide
          sqoop-qa Sqoop QA bot added a comment -

          Testing file SQOOP-1859.5.patch against branch sqoop2 took 0:00:05.714791.

          Overall: -1 due to an error

          ERROR: failed to apply patch (exit code 1):

          error: patch failed: common-test/src/main/java/org/apache/sqoop/common/test/db/DatabaseProvider.java:21
          error: common-test/src/main/java/org/apache/sqoop/common/test/db/DatabaseProvider.java: patch does not apply
          error: patch failed: connector/pom.xml:37
          error: connector/pom.xml: patch does not apply
          error: patch failed: server/pom.xml:84
          error: server/pom.xml: patch does not apply
          error: patch failed: test/src/main/java/org/apache/sqoop/test/minicluster/TomcatSqoopMiniCluster.java:95
          error: test/src/main/java/org/apache/sqoop/test/minicluster/TomcatSqoopMiniCluster.java: patch does not apply
          

          SUCCESS: Clean was successful

          Console output is available here.

          This message is automatically generated.

          Show
          sqoop-qa Sqoop QA bot added a comment - Testing file SQOOP-1859.5.patch against branch sqoop2 took 0:00:05.714791. Overall: -1 due to an error ERROR: failed to apply patch (exit code 1): error: patch failed: common-test/src/main/java/org/apache/sqoop/common/test/db/DatabaseProvider.java:21 error: common-test/src/main/java/org/apache/sqoop/common/test/db/DatabaseProvider.java: patch does not apply error: patch failed: connector/pom.xml:37 error: connector/pom.xml: patch does not apply error: patch failed: server/pom.xml:84 error: server/pom.xml: patch does not apply error: patch failed: test/src/main/java/org/apache/sqoop/test/minicluster/TomcatSqoopMiniCluster.java:95 error: test/src/main/java/org/apache/sqoop/test/minicluster/TomcatSqoopMiniCluster.java: patch does not apply SUCCESS: Clean was successful Console output is available here . This message is automatically generated.
          Hide
          gwenshap Gwen Shapira added a comment -

          Hi Abraham Elmahrek, reviving this zombie

          Did we ever figure out what to do with the shared code between Generic JDBC connector and MySQLFastConnector?
          I vaguely remember we thought that inheritance will limit us in the future, but I don't recall how we decided to resolve this.

          Also, are you adding integration tests here? in another JIRA?

          Show
          gwenshap Gwen Shapira added a comment - Hi Abraham Elmahrek , reviving this zombie Did we ever figure out what to do with the shared code between Generic JDBC connector and MySQLFastConnector? I vaguely remember we thought that inheritance will limit us in the future, but I don't recall how we decided to resolve this. Also, are you adding integration tests here? in another JIRA?
          Hide
          sqoop-qa Sqoop QA bot added a comment -

          Testing file SQOOP-1859.5.patch against branch sqoop2 took 0:23:14.125176.

          Overall: +1 all checks pass

          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch add/modify test case
          SUCCESS: Patch compiled
          SUCCESS: All unit tests passed
          SUCCESS: All integration tests passed

          Console output is available here.

          This message is automatically generated.

          Show
          sqoop-qa Sqoop QA bot added a comment - Testing file SQOOP-1859.5.patch against branch sqoop2 took 0:23:14.125176. Overall: +1 all checks pass SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch add/modify test case SUCCESS: Patch compiled SUCCESS: All unit tests passed SUCCESS: All integration tests passed Console output is available here . This message is automatically generated.
          Hide
          abec Abraham Elmahrek added a comment -

          Unit tests are failing because of a regex syntax being used that's available in JDK 1.7 only. Integration tests seem to be some strange issue where the new connector is included twice.

          Show
          abec Abraham Elmahrek added a comment - Unit tests are failing because of a regex syntax being used that's available in JDK 1.7 only. Integration tests seem to be some strange issue where the new connector is included twice.
          Hide
          sqoop-qa Sqoop QA bot added a comment -

          Testing file SQOOP-1859.3.patch against branch sqoop2 took 1:03:01.230591.

          Overall: -1 due to 14 errors

          ERROR: Some unit tests failed
          ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestMySQLDumpProcessBuilder
          ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestLinkConfiguration
          ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestMySQLImportProcessBuilder
          ERROR: Some integration tests failed
          ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.FromHDFSToRDBMSTest
          ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestMySQLDumpProcessBuilder
          ERROR: Failed integration test: org.apache.sqoop.integration.server.SubmissionWithDisabledModelObjectsTest
          ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestMySQLImportProcessBuilder
          ERROR: Failed integration test: org.apache.sqoop.integration.server.VersionTest
          ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.PartitionerTest
          ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestLinkConfiguration
          ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.FromRDBMSToHDFSTest
          ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.TableStagedRDBMSTest
          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch add/modify test case
          SUCCESS: Patch compiled

          Console output is available here.

          This message is automatically generated.

          Show
          sqoop-qa Sqoop QA bot added a comment - Testing file SQOOP-1859.3.patch against branch sqoop2 took 1:03:01.230591. Overall: -1 due to 14 errors ERROR: Some unit tests failed ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestMySQLDumpProcessBuilder ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestLinkConfiguration ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestMySQLImportProcessBuilder ERROR: Some integration tests failed ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.FromHDFSToRDBMSTest ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestMySQLDumpProcessBuilder ERROR: Failed integration test: org.apache.sqoop.integration.server.SubmissionWithDisabledModelObjectsTest ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestMySQLImportProcessBuilder ERROR: Failed integration test: org.apache.sqoop.integration.server.VersionTest ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.PartitionerTest ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestLinkConfiguration ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.FromRDBMSToHDFSTest ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.TableStagedRDBMSTest SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch add/modify test case SUCCESS: Patch compiled Console output is available here . This message is automatically generated.
          Hide
          sqoop-qa Sqoop QA bot added a comment -

          Testing file SQOOP-1859.3.patch against branch sqoop2 took 1:03:08.805099.

          Overall: -1 due to 14 errors

          ERROR: Some unit tests failed
          ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestMySQLDumpProcessBuilder
          ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestLinkConfiguration
          ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestMySQLImportProcessBuilder
          ERROR: Some integration tests failed
          ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.FromHDFSToRDBMSTest
          ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestMySQLDumpProcessBuilder
          ERROR: Failed integration test: org.apache.sqoop.integration.server.SubmissionWithDisabledModelObjectsTest
          ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestMySQLImportProcessBuilder
          ERROR: Failed integration test: org.apache.sqoop.integration.server.VersionTest
          ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.PartitionerTest
          ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestLinkConfiguration
          ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.FromRDBMSToHDFSTest
          ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.TableStagedRDBMSTest
          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch add/modify test case
          SUCCESS: Patch compiled

          Console output is available here.

          This message is automatically generated.

          Show
          sqoop-qa Sqoop QA bot added a comment - Testing file SQOOP-1859.3.patch against branch sqoop2 took 1:03:08.805099. Overall: -1 due to 14 errors ERROR: Some unit tests failed ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestMySQLDumpProcessBuilder ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestLinkConfiguration ERROR: Failed unit test: org.apache.sqoop.connector.mysqldump.TestMySQLImportProcessBuilder ERROR: Some integration tests failed ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.FromHDFSToRDBMSTest ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestMySQLDumpProcessBuilder ERROR: Failed integration test: org.apache.sqoop.integration.server.SubmissionWithDisabledModelObjectsTest ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestMySQLImportProcessBuilder ERROR: Failed integration test: org.apache.sqoop.integration.server.VersionTest ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.PartitionerTest ERROR: Failed integration test: org.apache.sqoop.connector.mysqldump.TestLinkConfiguration ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.FromRDBMSToHDFSTest ERROR: Failed integration test: org.apache.sqoop.integration.connector.jdbc.generic.TableStagedRDBMSTest SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch add/modify test case SUCCESS: Patch compiled Console output is available here . This message is automatically generated.
          Hide
          sqoop-qa Sqoop QA bot added a comment -

          Testing file SQOOP-1859.2.patch against branch sqoop2 took 0:00:48.395635.

          Overall: -1 due to an error

          ERROR: failed to build with patch (exit code 1)
          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch add/modify test case

          Console output is available here.

          This message is automatically generated.

          Show
          sqoop-qa Sqoop QA bot added a comment - Testing file SQOOP-1859.2.patch against branch sqoop2 took 0:00:48.395635. Overall: -1 due to an error ERROR: failed to build with patch (exit code 1) SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch add/modify test case Console output is available here . This message is automatically generated.
          Hide
          sqoop-qa Sqoop QA bot added a comment -

          Testing file SQOOP-1859.1.patch against branch sqoop2 took 0:00:45.082560.

          Overall: -1 due to an error

          ERROR: failed to build with patch (exit code 1)
          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch add/modify test case

          Console output is available here.

          This message is automatically generated.

          Show
          sqoop-qa Sqoop QA bot added a comment - Testing file SQOOP-1859.1.patch against branch sqoop2 took 0:00:45.082560. Overall: -1 due to an error ERROR: failed to build with patch (exit code 1) SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch add/modify test case Console output is available here . This message is automatically generated.
          Hide
          sqoop-qa Sqoop QA bot added a comment -

          Testing file SQOOP-1859.0.patch against branch sqoop2 took 0:00:41.627762.

          Overall: -1 due to an error

          ERROR: failed to build with patch (exit code 1)
          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch add/modify test case

          Console output is available here.

          This message is automatically generated.

          Show
          sqoop-qa Sqoop QA bot added a comment - Testing file SQOOP-1859.0.patch against branch sqoop2 took 0:00:41.627762. Overall: -1 due to an error ERROR: failed to build with patch (exit code 1) SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch add/modify test case Console output is available here . This message is automatically generated.

            People

            • Assignee:
              abec Abraham Elmahrek
              Reporter:
              abec Abraham Elmahrek
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:

                Development