Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-621

Requesting support for upsert export with MySQL

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.2
    • 1.4.3
    • connectors/mysql

    Description

      Sqoop export with upsert option gives the following error:
      12/09/26 11:34:54 ERROR tool.ExportTool: Error during export: Mixed update/insert is not supported against the target database yet

      From the code it seems to me that upsert is implemented only for Oracle as of now.

      Attachments

        1. bugSQOOP-621.patch
          11 kB
          Jarek Jarcec Cecho

        Issue Links

          Activity

            raghavgautam Raghav Kumar Gautam added a comment - Also see this thread: http://mail-archives.apache.org/mod_mbox/sqoop-user/201210.mbox/%3C20121004152956.GT16616%40jarcec-thinkpad%3E
            cheolsoo Cheolsoo Park added a comment -

            Thanks a lot Jarcec. The patch is in.

            I am sorry that I forgot to add (Jarek Jarcec Cecho via Cheolsoo Park) in the commit record. I realized after I had commit... My bad.

            cheolsoo Cheolsoo Park added a comment - Thanks a lot Jarcec. The patch is in. I am sorry that I forgot to add (Jarek Jarcec Cecho via Cheolsoo Park) in the commit record. I realized after I had commit... My bad.

            That's fine sir, it happens - I won't be mad

            jarcec Jarek Jarcec Cecho added a comment - That's fine sir, it happens - I won't be mad
            hudson Hudson added a comment -

            Integrated in Sqoop-ant-jdk-1.6-hadoop20 #220 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/220/)
            SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23)

            Result = SUCCESS
            cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23
            Files :

            • src/java/org/apache/sqoop/manager/MySQLManager.java
            • src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java
            • src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java
            • src/java/org/apache/sqoop/manager/DirectMySQLManager.java
            • src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java
            • src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java
            • src/docs/user/connectors.txt
            hudson Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop20 #220 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/220/ ) SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23 Files : src/java/org/apache/sqoop/manager/MySQLManager.java src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java src/java/org/apache/sqoop/manager/DirectMySQLManager.java src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java src/docs/user/connectors.txt
            hudson Hudson added a comment -

            Integrated in Sqoop-ant-jdk-1.6-hadoop100 #219 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/219/)
            SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23)

            Result = SUCCESS
            cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23
            Files :

            • src/docs/user/connectors.txt
            • src/java/org/apache/sqoop/manager/MySQLManager.java
            • src/java/org/apache/sqoop/manager/DirectMySQLManager.java
            • src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java
            • src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java
            • src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java
            • src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java
            hudson Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop100 #219 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/219/ ) SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23 Files : src/docs/user/connectors.txt src/java/org/apache/sqoop/manager/MySQLManager.java src/java/org/apache/sqoop/manager/DirectMySQLManager.java src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java
            hudson Hudson added a comment -

            Integrated in Sqoop-ant-jdk-1.6-hadoop200 #229 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/229/)
            SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23)

            Result = SUCCESS
            cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23
            Files :

            • src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java
            • src/java/org/apache/sqoop/manager/DirectMySQLManager.java
            • src/docs/user/connectors.txt
            • src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java
            • src/java/org/apache/sqoop/manager/MySQLManager.java
            • src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java
            • src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java
            hudson Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop200 #229 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/229/ ) SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23 Files : src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java src/java/org/apache/sqoop/manager/DirectMySQLManager.java src/docs/user/connectors.txt src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java src/java/org/apache/sqoop/manager/MySQLManager.java src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java
            hudson Hudson added a comment -

            Integrated in Sqoop-ant-jdk-1.6-hadoop23 #369 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/369/)
            SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23)

            Result = SUCCESS
            cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23
            Files :

            • src/docs/user/connectors.txt
            • src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java
            • src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java
            • src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java
            • src/java/org/apache/sqoop/manager/MySQLManager.java
            • src/java/org/apache/sqoop/manager/DirectMySQLManager.java
            • src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java
            hudson Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop23 #369 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/369/ ) SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23 Files : src/docs/user/connectors.txt src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java src/java/org/apache/sqoop/manager/MySQLManager.java src/java/org/apache/sqoop/manager/DirectMySQLManager.java src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java

            People

              jarcec Jarek Jarcec Cecho
              raghavgautam Raghav Kumar Gautam
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: