Sqoop
  1. Sqoop
  2. SQOOP-842

Sqoop2: Put partition to template in Extractor as well

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 1.99.1
    • Fix Version/s: 1.99.2
    • Component/s: None
    • Labels:
      None

      Description

      We've introduced templating in SQOOP-682 for ETL classes for configuration objects. I believe that partition is also a good candidate to be used as generic as it's also connector specific.

      1. bugSQOOP-842.patch
        10 kB
        Jarek Jarcec Cecho

        Issue Links

          Activity

          Hide
          Cheolsoo Park added a comment -

          +1.

          Show
          Cheolsoo Park added a comment - +1.
          Hide
          Cheolsoo Park added a comment -

          Committed to sqoop2. Thanks Jarcec!

          Show
          Cheolsoo Park added a comment - Committed to sqoop2. Thanks Jarcec!
          Hide
          Hudson added a comment -

          Integrated in Sqoop2-hadoop200 #171 (See https://builds.apache.org/job/Sqoop2-hadoop200/171/)
          SQOOP-842: Put partition to template in Extractor as well (Revision 92062d5343e6318fe703b06e30c52920938818b0)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=92062d5343e6318fe703b06e30c52920938818b0
          Files :

          • execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsTextExportExtractor.java
          • execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsSequenceExportExtractor.java
          • spi/src/main/java/org/apache/sqoop/job/etl/Extractor.java
          • execution/mapreduce/src/test/java/org/apache/sqoop/job/TestMapReduce.java
          • execution/mapreduce/src/test/java/org/apache/sqoop/job/TestHdfsLoad.java
          • connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportExtractor.java
          Show
          Hudson added a comment - Integrated in Sqoop2-hadoop200 #171 (See https://builds.apache.org/job/Sqoop2-hadoop200/171/ ) SQOOP-842 : Put partition to template in Extractor as well (Revision 92062d5343e6318fe703b06e30c52920938818b0) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=92062d5343e6318fe703b06e30c52920938818b0 Files : execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsTextExportExtractor.java execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsSequenceExportExtractor.java spi/src/main/java/org/apache/sqoop/job/etl/Extractor.java execution/mapreduce/src/test/java/org/apache/sqoop/job/TestMapReduce.java execution/mapreduce/src/test/java/org/apache/sqoop/job/TestHdfsLoad.java connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportExtractor.java
          Hide
          Hudson added a comment -

          Integrated in Sqoop2-hadoop100 #157 (See https://builds.apache.org/job/Sqoop2-hadoop100/157/)
          SQOOP-842: Put partition to template in Extractor as well (Revision 92062d5343e6318fe703b06e30c52920938818b0)

          Result = SUCCESS
          cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=92062d5343e6318fe703b06e30c52920938818b0
          Files :

          • execution/mapreduce/src/test/java/org/apache/sqoop/job/TestMapReduce.java
          • connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportExtractor.java
          • execution/mapreduce/src/test/java/org/apache/sqoop/job/TestHdfsLoad.java
          • spi/src/main/java/org/apache/sqoop/job/etl/Extractor.java
          • execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsTextExportExtractor.java
          • execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsSequenceExportExtractor.java
          Show
          Hudson added a comment - Integrated in Sqoop2-hadoop100 #157 (See https://builds.apache.org/job/Sqoop2-hadoop100/157/ ) SQOOP-842 : Put partition to template in Extractor as well (Revision 92062d5343e6318fe703b06e30c52920938818b0) Result = SUCCESS cheolsoo : https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=92062d5343e6318fe703b06e30c52920938818b0 Files : execution/mapreduce/src/test/java/org/apache/sqoop/job/TestMapReduce.java connector/connector-generic-jdbc/src/main/java/org/apache/sqoop/connector/jdbc/GenericJdbcImportExtractor.java execution/mapreduce/src/test/java/org/apache/sqoop/job/TestHdfsLoad.java spi/src/main/java/org/apache/sqoop/job/etl/Extractor.java execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsTextExportExtractor.java execution/mapreduce/src/main/java/org/apache/sqoop/job/etl/HdfsSequenceExportExtractor.java

            People

            • Assignee:
              Jarek Jarcec Cecho
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development