Sqoop
  1. Sqoop
  2. SQOOP-621

Requesting support for upsert export with MySQL

    Details

    • Type: New Feature New Feature
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.2
    • Fix Version/s: 1.4.3
    • Component/s: connectors/mysql
    • Labels:

      Description

      Sqoop export with upsert option gives the following error:
      12/09/26 11:34:54 ERROR tool.ExportTool: Error during export: Mixed update/insert is not supported against the target database yet

      From the code it seems to me that upsert is implemented only for Oracle as of now.

      1. bugSQOOP-621.patch
        11 kB
        Jarek Jarcec Cecho

        Issue Links

          Activity

          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop23 #369 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/369/)
          SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23
          Files :

          • src/docs/user/connectors.txt
          • src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java
          • src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java
          • src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java
          • src/java/org/apache/sqoop/manager/MySQLManager.java
          • src/java/org/apache/sqoop/manager/DirectMySQLManager.java
          • src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop23 #369 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/369/ ) SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23 Files : src/docs/user/connectors.txt src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java src/java/org/apache/sqoop/manager/MySQLManager.java src/java/org/apache/sqoop/manager/DirectMySQLManager.java src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop200 #229 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/229/)
          SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23
          Files :

          • src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java
          • src/java/org/apache/sqoop/manager/DirectMySQLManager.java
          • src/docs/user/connectors.txt
          • src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java
          • src/java/org/apache/sqoop/manager/MySQLManager.java
          • src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java
          • src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop200 #229 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/229/ ) SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23 Files : src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java src/java/org/apache/sqoop/manager/DirectMySQLManager.java src/docs/user/connectors.txt src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java src/java/org/apache/sqoop/manager/MySQLManager.java src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop100 #219 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/219/)
          SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23
          Files :

          • src/docs/user/connectors.txt
          • src/java/org/apache/sqoop/manager/MySQLManager.java
          • src/java/org/apache/sqoop/manager/DirectMySQLManager.java
          • src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java
          • src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java
          • src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java
          • src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop100 #219 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/219/ ) SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23 Files : src/docs/user/connectors.txt src/java/org/apache/sqoop/manager/MySQLManager.java src/java/org/apache/sqoop/manager/DirectMySQLManager.java src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop20 #220 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/220/)
          SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23
          Files :

          • src/java/org/apache/sqoop/manager/MySQLManager.java
          • src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java
          • src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java
          • src/java/org/apache/sqoop/manager/DirectMySQLManager.java
          • src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java
          • src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java
          • src/docs/user/connectors.txt
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop20 #220 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/220/ ) SQOOP-621 Requesting support for upsert export with MySQL (Revision 2750df90f96f75f6e70bf690b88faba21fc8ab23) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=2750df90f96f75f6e70bf690b88faba21fc8ab23 Files : src/java/org/apache/sqoop/manager/MySQLManager.java src/test/com/cloudera/sqoop/manager/ManualMySQLTests.java src/java/org/apache/sqoop/mapreduce/mysql/MySQLUpsertOutputFormat.java src/java/org/apache/sqoop/manager/DirectMySQLManager.java src/test/com/cloudera/sqoop/manager/JdbcMySQLExportTest.java src/java/org/apache/sqoop/mapreduce/JdbcUpdateExportJob.java src/docs/user/connectors.txt
          Hide
          Jarek Jarcec Cecho added a comment -

          That's fine sir, it happens - I won't be mad

          Show
          Jarek Jarcec Cecho added a comment - That's fine sir, it happens - I won't be mad
          Hide
          Cheolsoo Park added a comment -

          Thanks a lot Jarcec. The patch is in.

          I am sorry that I forgot to add (Jarek Jarcec Cecho via Cheolsoo Park) in the commit record. I realized after I had commit... My bad.

          Show
          Cheolsoo Park added a comment - Thanks a lot Jarcec. The patch is in. I am sorry that I forgot to add (Jarek Jarcec Cecho via Cheolsoo Park) in the commit record. I realized after I had commit... My bad.
          Show
          Raghav Kumar Gautam added a comment - Also see this thread: http://mail-archives.apache.org/mod_mbox/sqoop-user/201210.mbox/%3C20121004152956.GT16616%40jarcec-thinkpad%3E

            People

            • Assignee:
              Jarek Jarcec Cecho
              Reporter:
              Raghav Kumar Gautam
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development