Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-1309

Expand the Sqoop to support CUBRID database.

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.5
    • 1.4.6
    • None
    • None

    Description

      We often need to get the data from the Apache Hadoop migrated to a relational database, or from
      relational database migration to Hadoop. Apache Sqoop provides convenient and efficient for us. But It could not support CUBRID, I want expand the Sqoop tools to support CUBRID for migration.

      Improvement:
      Through CUBRID JDBC to support sqoop-import and sqoop-export operation
      Support various database data types of CUBRID conversion
      Support to migrate data between HDFS/Hive/HBase and CUBRID.

      Appendix
      CUBRID: http://www.cubrid.org/

      Attachments

        1. patch-file.patch
          48 kB
          Chenqiang

        Issue Links

          Activity

            Good idea chenq, that might be indeed helpful! Are you planning to work on this one?

            jarcec Jarek Jarcec Cecho added a comment - Good idea chenq , that might be indeed helpful! Are you planning to work on this one?
            chenq Chenqiang added a comment -

            Thanks for your support, I am very happy to complete this function.

            chenq Chenqiang added a comment - Thanks for your support, I am very happy to complete this function.

            I'm assigning this ticket you you then chenq.

            jarcec Jarek Jarcec Cecho added a comment - I'm assigning this ticket you you then chenq .
            chenq Chenqiang added a comment -

            OK, I have seen that this ticket is assigned to me.

            Now, I want to know which branch I will begin from source.

            Current branch list:
            origin/SQOOP-1082
            origin/branch-1.4.0
            origin/branch-1.4.1
            origin/branch-1.4.2
            origin/branch-1.4.3
            origin/branch-1.4.4
            origin/branch-1.99.1
            origin/branch-1.99.2
            origin/branch-1.99.3
            origin/sqoop2
            origin/trunk

            Shall I change to the branch origin/branch-1.4.4? And I will add new feature on this branch and submit my new codes.

            Thanks

            chenq Chenqiang added a comment - OK, I have seen that this ticket is assigned to me. Now, I want to know which branch I will begin from source. Current branch list: origin/ SQOOP-1082 origin/branch-1.4.0 origin/branch-1.4.1 origin/branch-1.4.2 origin/branch-1.4.3 origin/branch-1.4.4 origin/branch-1.99.1 origin/branch-1.99.2 origin/branch-1.99.3 origin/sqoop2 origin/trunk Shall I change to the branch origin/branch-1.4.4? And I will add new feature on this branch and submit my new codes. Thanks

            The change should be definitely developed against trunk branch chenq.

            jarcec Jarek Jarcec Cecho added a comment - The change should be definitely developed against trunk branch chenq .
            chenq Chenqiang added a comment -

            OK, Thank you.
            I am going to develop this task now. When I prepare to submit the code, Maybe have some problems also.

            chenq Chenqiang added a comment - OK, Thank you. I am going to develop this task now. When I prepare to submit the code, Maybe have some problems also.

            Sure, let us know if you will have any difficulties chenq!

            jarcec Jarek Jarcec Cecho added a comment - Sure, let us know if you will have any difficulties chenq !
            chenq Chenqiang added a comment -

            Now, I want to commit the new code.
            Could you tell me what the submission process is?

            chenq Chenqiang added a comment - Now, I want to commit the new code. Could you tell me what the submission process is?

            Check out How to Contribute wiki page, chenq. If you have patch ready, please upload it to Review board.

            jarcec Jarek Jarcec Cecho added a comment - Check out How to Contribute wiki page, chenq . If you have patch ready, please upload it to Review board .
            chenq Chenqiang added a comment -

            SQOOP-1309 submit patch.

            chenq Chenqiang added a comment - SQOOP-1309 submit patch.
            chenq Chenqiang added a comment - - edited

            I have submited the review patch on Review board.
            https://reviews.apache.org/r/21100/

            Thanks

            chenq Chenqiang added a comment - - edited I have submited the review patch on Review board. https://reviews.apache.org/r/21100/ Thanks

            I left couple comments on review board chenq.

            jarcec Jarek Jarcec Cecho added a comment - I left couple comments on review board chenq .

            Canceling patch as we're waiting on incorporating feedback from the review.

            jarcec Jarek Jarcec Cecho added a comment - Canceling patch as we're waiting on incorporating feedback from the review.

            Putting back to patch available state.

            jarcec Jarek Jarcec Cecho added a comment - Putting back to patch available state.
            chenq Chenqiang added a comment -

            Upload the patch.
            Thanks

            chenq Chenqiang added a comment - Upload the patch. Thanks

            Commit e0fc46e949d878cf52f93b0206facf2db73f4d5c in sqoop's branch refs/heads/trunk from jarcec
            [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=e0fc46e ]

            SQOOP-1309: Expand the Sqoop to support CUBRID database.

            jira-bot ASF subversion and git services added a comment - Commit e0fc46e949d878cf52f93b0206facf2db73f4d5c in sqoop's branch refs/heads/trunk from jarcec [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=e0fc46e ] SQOOP-1309 : Expand the Sqoop to support CUBRID database.

            Committed to trunk, thank you chenq!

            jarcec Jarek Jarcec Cecho added a comment - Committed to trunk, thank you chenq !
            hudson Hudson added a comment -

            SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #887 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/887/)
            SQOOP-1309: Expand the Sqoop to support CUBRID database. (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=e0fc46e949d878cf52f93b0206facf2db73f4d5c)

            • COMPILING.txt
            • src/test/org/apache/sqoop/manager/cubrid/CubridAuthTest.java
            • src/test/com/cloudera/sqoop/manager/CubridManagerExportTest.java
            • src/java/org/apache/sqoop/manager/DefaultManagerFactory.java
            • src/test/org/apache/sqoop/manager/cubrid/CubridCompatTest.java
            • src/test/com/cloudera/sqoop/manager/CubridManagerImportTest.java
            • src/test/com/cloudera/sqoop/ThirdPartyTests.java
            • src/java/org/apache/sqoop/mapreduce/cubrid/CubridUpsertOutputFormat.java
            • src/java/org/apache/sqoop/manager/CubridManager.java
            • src/test/org/apache/sqoop/manager/cubrid/CubridTestUtils.java
            • src/docs/user/compatibility.txt
            • build.xml
            hudson Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop100 #887 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/887/ ) SQOOP-1309 : Expand the Sqoop to support CUBRID database. (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=e0fc46e949d878cf52f93b0206facf2db73f4d5c ) COMPILING.txt src/test/org/apache/sqoop/manager/cubrid/CubridAuthTest.java src/test/com/cloudera/sqoop/manager/CubridManagerExportTest.java src/java/org/apache/sqoop/manager/DefaultManagerFactory.java src/test/org/apache/sqoop/manager/cubrid/CubridCompatTest.java src/test/com/cloudera/sqoop/manager/CubridManagerImportTest.java src/test/com/cloudera/sqoop/ThirdPartyTests.java src/java/org/apache/sqoop/mapreduce/cubrid/CubridUpsertOutputFormat.java src/java/org/apache/sqoop/manager/CubridManager.java src/test/org/apache/sqoop/manager/cubrid/CubridTestUtils.java src/docs/user/compatibility.txt build.xml
            hudson Hudson added a comment -

            FAILURE: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #923 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/923/)
            SQOOP-1309: Expand the Sqoop to support CUBRID database. (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=e0fc46e949d878cf52f93b0206facf2db73f4d5c)

            • src/java/org/apache/sqoop/manager/CubridManager.java
            • src/test/org/apache/sqoop/manager/cubrid/CubridAuthTest.java
            • COMPILING.txt
            • src/test/com/cloudera/sqoop/manager/CubridManagerExportTest.java
            • src/test/com/cloudera/sqoop/ThirdPartyTests.java
            • src/test/org/apache/sqoop/manager/cubrid/CubridTestUtils.java
            • src/java/org/apache/sqoop/manager/DefaultManagerFactory.java
            • src/docs/user/compatibility.txt
            • src/test/org/apache/sqoop/manager/cubrid/CubridCompatTest.java
            • src/test/com/cloudera/sqoop/manager/CubridManagerImportTest.java
            • src/java/org/apache/sqoop/mapreduce/cubrid/CubridUpsertOutputFormat.java
            • build.xml
            hudson Hudson added a comment - FAILURE: Integrated in Sqoop-ant-jdk-1.6-hadoop20 #923 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/923/ ) SQOOP-1309 : Expand the Sqoop to support CUBRID database. (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=e0fc46e949d878cf52f93b0206facf2db73f4d5c ) src/java/org/apache/sqoop/manager/CubridManager.java src/test/org/apache/sqoop/manager/cubrid/CubridAuthTest.java COMPILING.txt src/test/com/cloudera/sqoop/manager/CubridManagerExportTest.java src/test/com/cloudera/sqoop/ThirdPartyTests.java src/test/org/apache/sqoop/manager/cubrid/CubridTestUtils.java src/java/org/apache/sqoop/manager/DefaultManagerFactory.java src/docs/user/compatibility.txt src/test/org/apache/sqoop/manager/cubrid/CubridCompatTest.java src/test/com/cloudera/sqoop/manager/CubridManagerImportTest.java src/java/org/apache/sqoop/mapreduce/cubrid/CubridUpsertOutputFormat.java build.xml
            hudson Hudson added a comment -

            SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #929 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/929/)
            SQOOP-1309: Expand the Sqoop to support CUBRID database. (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=e0fc46e949d878cf52f93b0206facf2db73f4d5c)

            • src/test/org/apache/sqoop/manager/cubrid/CubridTestUtils.java
            • src/test/com/cloudera/sqoop/manager/CubridManagerExportTest.java
            • src/java/org/apache/sqoop/mapreduce/cubrid/CubridUpsertOutputFormat.java
            • src/java/org/apache/sqoop/manager/DefaultManagerFactory.java
            • src/docs/user/compatibility.txt
            • src/test/com/cloudera/sqoop/ThirdPartyTests.java
            • build.xml
            • src/test/org/apache/sqoop/manager/cubrid/CubridAuthTest.java
            • src/java/org/apache/sqoop/manager/CubridManager.java
            • COMPILING.txt
            • src/test/com/cloudera/sqoop/manager/CubridManagerImportTest.java
            • src/test/org/apache/sqoop/manager/cubrid/CubridCompatTest.java
            hudson Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop200 #929 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/929/ ) SQOOP-1309 : Expand the Sqoop to support CUBRID database. (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=e0fc46e949d878cf52f93b0206facf2db73f4d5c ) src/test/org/apache/sqoop/manager/cubrid/CubridTestUtils.java src/test/com/cloudera/sqoop/manager/CubridManagerExportTest.java src/java/org/apache/sqoop/mapreduce/cubrid/CubridUpsertOutputFormat.java src/java/org/apache/sqoop/manager/DefaultManagerFactory.java src/docs/user/compatibility.txt src/test/com/cloudera/sqoop/ThirdPartyTests.java build.xml src/test/org/apache/sqoop/manager/cubrid/CubridAuthTest.java src/java/org/apache/sqoop/manager/CubridManager.java COMPILING.txt src/test/com/cloudera/sqoop/manager/CubridManagerImportTest.java src/test/org/apache/sqoop/manager/cubrid/CubridCompatTest.java
            hudson Hudson added a comment -

            SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1126 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1126/)
            SQOOP-1309: Expand the Sqoop to support CUBRID database. (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=e0fc46e949d878cf52f93b0206facf2db73f4d5c)

            • COMPILING.txt
            • src/test/com/cloudera/sqoop/ThirdPartyTests.java
            • src/docs/user/compatibility.txt
            • src/test/org/apache/sqoop/manager/cubrid/CubridCompatTest.java
            • src/test/com/cloudera/sqoop/manager/CubridManagerExportTest.java
            • build.xml
            • src/test/com/cloudera/sqoop/manager/CubridManagerImportTest.java
            • src/test/org/apache/sqoop/manager/cubrid/CubridTestUtils.java
            • src/test/org/apache/sqoop/manager/cubrid/CubridAuthTest.java
            • src/java/org/apache/sqoop/mapreduce/cubrid/CubridUpsertOutputFormat.java
            • src/java/org/apache/sqoop/manager/CubridManager.java
            • src/java/org/apache/sqoop/manager/DefaultManagerFactory.java
            hudson Hudson added a comment - SUCCESS: Integrated in Sqoop-ant-jdk-1.6-hadoop23 #1126 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/1126/ ) SQOOP-1309 : Expand the Sqoop to support CUBRID database. (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=e0fc46e949d878cf52f93b0206facf2db73f4d5c ) COMPILING.txt src/test/com/cloudera/sqoop/ThirdPartyTests.java src/docs/user/compatibility.txt src/test/org/apache/sqoop/manager/cubrid/CubridCompatTest.java src/test/com/cloudera/sqoop/manager/CubridManagerExportTest.java build.xml src/test/com/cloudera/sqoop/manager/CubridManagerImportTest.java src/test/org/apache/sqoop/manager/cubrid/CubridTestUtils.java src/test/org/apache/sqoop/manager/cubrid/CubridAuthTest.java src/java/org/apache/sqoop/mapreduce/cubrid/CubridUpsertOutputFormat.java src/java/org/apache/sqoop/manager/CubridManager.java src/java/org/apache/sqoop/manager/DefaultManagerFactory.java

            People

              chenq Chenqiang
              chenq Chenqiang
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - 336h
                  336h
                  Remaining:
                  Remaining Estimate - 336h
                  336h
                  Logged:
                  Time Spent - Not Specified
                  Not Specified