Sqoop
  1. Sqoop
  2. SQOOP-1118

Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql

    Details

    • Type: Task Task
    • Status: Resolved
    • Priority: Trivial Trivial
    • Resolution: Fixed
    • Affects Version/s: 1.4.4
    • Fix Version/s: 1.4.4
    • Component/s: connectors/postgresql
    • Labels:
      None

      Description

      for refactoring of the org.apache.sqoop.mapreduce package.

      1. SQOOP-1118-move-postgresql-specific-mr-codes.patch
        48 kB
        Masatake Iwasaki
      2. SQOOP-1118-1.patch
        46 kB
        Masatake Iwasaki

        Issue Links

          Activity

          Hide
          Masatake Iwasaki added a comment -

          Attached patch includes following changes:
          1. codes in org.apache.sqoop.mapreduce are moved to org.apache.sqoop.mapreduce.postgresql,
          2. settings for PGBulkloadManagerManualTest such as database, and username ,tablespace and path of pg_bulkload are made configurable via system property,
          3. using not Configuration but JobConf in PGBulkloadManagerManualTest to follow changes in DBConfiguration,
          4. handling for the case JdbcUrl.getPort returns -1 is added to PGBulkloadExportMapper.

          Show
          Masatake Iwasaki added a comment - Attached patch includes following changes: 1. codes in org.apache.sqoop.mapreduce are moved to org.apache.sqoop.mapreduce.postgresql, 2. settings for PGBulkloadManagerManualTest such as database, and username ,tablespace and path of pg_bulkload are made configurable via system property, 3. using not Configuration but JobConf in PGBulkloadManagerManualTest to follow changes in DBConfiguration, 4. handling for the case JdbcUrl.getPort returns -1 is added to PGBulkloadExportMapper.
          Hide
          Masatake Iwasaki added a comment -

          attaching reviewed patch.

          Show
          Masatake Iwasaki added a comment - attaching reviewed patch.
          Hide
          ASF subversion and git services added a comment -

          Commit b8fd60202865fa5c58c61361c45496e01bf05456 in branch refs/heads/trunk from Jarek Jarcec Cecho
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=b8fd602 ]

          SQOOP-1118: Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql

          (Masatake Iwasaki via Jarek Jarcec Cecho)

          Show
          ASF subversion and git services added a comment - Commit b8fd60202865fa5c58c61361c45496e01bf05456 in branch refs/heads/trunk from Jarek Jarcec Cecho [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=b8fd602 ] SQOOP-1118 : Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql (Masatake Iwasaki via Jarek Jarcec Cecho)
          Hide
          Jarek Jarcec Cecho added a comment -

          Thank you for your contribution Masatake Iwasaki!

          Show
          Jarek Jarcec Cecho added a comment - Thank you for your contribution Masatake Iwasaki !
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop20 #792 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/792/)
          SQOOP-1118: Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql (Revision b8fd60202865fa5c58c61361c45496e01bf05456)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b8fd60202865fa5c58c61361c45496e01bf05456
          Files :

          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportReducer.java
          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportMapper.java
          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportJob.java
          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportJob.java
          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportReducer.java
          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportMapper.java
          • src/java/org/apache/sqoop/manager/PGBulkloadManager.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop20 #792 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop20/792/ ) SQOOP-1118 : Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql (Revision b8fd60202865fa5c58c61361c45496e01bf05456) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b8fd60202865fa5c58c61361c45496e01bf05456 Files : src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportReducer.java src/java/org/apache/sqoop/mapreduce/PGBulkloadExportMapper.java src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportJob.java src/java/org/apache/sqoop/mapreduce/PGBulkloadExportJob.java src/java/org/apache/sqoop/mapreduce/PGBulkloadExportReducer.java src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportMapper.java src/java/org/apache/sqoop/manager/PGBulkloadManager.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop200 #800 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/800/)
          SQOOP-1118: Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql (Revision b8fd60202865fa5c58c61361c45496e01bf05456)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b8fd60202865fa5c58c61361c45496e01bf05456
          Files :

          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportReducer.java
          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportReducer.java
          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportJob.java
          • src/java/org/apache/sqoop/manager/PGBulkloadManager.java
          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportMapper.java
          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportJob.java
          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportMapper.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop200 #800 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop200/800/ ) SQOOP-1118 : Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql (Revision b8fd60202865fa5c58c61361c45496e01bf05456) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b8fd60202865fa5c58c61361c45496e01bf05456 Files : src/java/org/apache/sqoop/mapreduce/PGBulkloadExportReducer.java src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportReducer.java src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportJob.java src/java/org/apache/sqoop/manager/PGBulkloadManager.java src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportMapper.java src/java/org/apache/sqoop/mapreduce/PGBulkloadExportJob.java src/java/org/apache/sqoop/mapreduce/PGBulkloadExportMapper.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop23 #993 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/993/)
          SQOOP-1118: Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql (Revision b8fd60202865fa5c58c61361c45496e01bf05456)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b8fd60202865fa5c58c61361c45496e01bf05456
          Files :

          • src/java/org/apache/sqoop/manager/PGBulkloadManager.java
          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportReducer.java
          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportReducer.java
          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportJob.java
          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportMapper.java
          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportJob.java
          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportMapper.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop23 #993 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop23/993/ ) SQOOP-1118 : Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql (Revision b8fd60202865fa5c58c61361c45496e01bf05456) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b8fd60202865fa5c58c61361c45496e01bf05456 Files : src/java/org/apache/sqoop/manager/PGBulkloadManager.java src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportReducer.java src/java/org/apache/sqoop/mapreduce/PGBulkloadExportReducer.java src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportJob.java src/java/org/apache/sqoop/mapreduce/PGBulkloadExportMapper.java src/java/org/apache/sqoop/mapreduce/PGBulkloadExportJob.java src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportMapper.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6-hadoop100 #752 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/752/)
          SQOOP-1118: Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql (Revision b8fd60202865fa5c58c61361c45496e01bf05456)

          Result = SUCCESS
          jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b8fd60202865fa5c58c61361c45496e01bf05456
          Files :

          • src/java/org/apache/sqoop/manager/PGBulkloadManager.java
          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportJob.java
          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportReducer.java
          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportMapper.java
          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportReducer.java
          • src/java/org/apache/sqoop/mapreduce/PGBulkloadExportMapper.java
          • src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportJob.java
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6-hadoop100 #752 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6-hadoop100/752/ ) SQOOP-1118 : Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql (Revision b8fd60202865fa5c58c61361c45496e01bf05456) Result = SUCCESS jarcec : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=b8fd60202865fa5c58c61361c45496e01bf05456 Files : src/java/org/apache/sqoop/manager/PGBulkloadManager.java src/java/org/apache/sqoop/mapreduce/PGBulkloadExportJob.java src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportReducer.java src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportMapper.java src/java/org/apache/sqoop/mapreduce/PGBulkloadExportReducer.java src/java/org/apache/sqoop/mapreduce/PGBulkloadExportMapper.java src/java/org/apache/sqoop/mapreduce/postgresql/PGBulkloadExportJob.java

            People

            • Assignee:
              Masatake Iwasaki
              Reporter:
              Masatake Iwasaki
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development