Sqoop
  1. Sqoop
  2. SQOOP-506 Create Sqoop integration test infrastructure.
  3. SQOOP-927

Sqoop2: Integration: Mapreduce specific tests should be running on MiniCluster

    Details

    • Type: Sub-task Sub-task
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 1.99.1
    • Fix Version/s: 1.99.4
    • Component/s: None
    • Labels:
      None

      Description

      Mapreduce specific tests should be running on MiniCluster rather than on LocalRunner as they behave differently.

      1. SQOOP-927.0.patch
        24 kB
        Abraham Elmahrek
      2. SQOOP-927.1.patch
        25 kB
        Abraham Elmahrek
      3. SQOOP-927.2.patch
        25 kB
        Abraham Elmahrek

        Issue Links

          Activity

          Jarek Jarcec Cecho created issue -
          Jarek Jarcec Cecho made changes -
          Field Original Value New Value
          Fix Version/s 2.0.0 [ 12319272 ]
          Abraham Elmahrek made changes -
          Assignee Abraham Elmahrek [ abec ]
          Jonathan Hsieh made changes -
          Link This issue relates to HBASE-8528 [ HBASE-8528 ]
          Hide
          Jarek Jarcec Cecho added a comment -

          Changing status of the JIRA to "Patch submitted" so that it will show up in the review queue.

          Show
          Jarek Jarcec Cecho added a comment - Changing status of the JIRA to "Patch submitted" so that it will show up in the review queue.
          Jarek Jarcec Cecho made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Jarek Jarcec Cecho made changes -
          Remote Link This issue links to "Review board (Web Link)" [ 12309 ]
          Hide
          Abraham Elmahrek added a comment -

          Rebased patch

          Show
          Abraham Elmahrek added a comment - Rebased patch
          Abraham Elmahrek made changes -
          Attachment SQOOP-927.0.patch [ 12598331 ]
          Hide
          Sqoop QA bot added a comment -

          Here are the results of testing the latest attachment
          https://issues.apache.org/jira/secure/attachment/12598331/SQOOP-927.0.patch against branch sqoop2.

          Overall: +1 all checks pass

          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch compiled
          SUCCESS: All tests passed

          Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/124/console

          This message is automatically generated.

          Show
          Sqoop QA bot added a comment - Here are the results of testing the latest attachment https://issues.apache.org/jira/secure/attachment/12598331/SQOOP-927.0.patch against branch sqoop2. Overall: +1 all checks pass SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch compiled SUCCESS: All tests passed Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/124/console This message is automatically generated.
          Hide
          Abraham Elmahrek added a comment -

          We'll have to use deprecated minicluster classes for MR for now because of HADOOP-10056.

          Show
          Abraham Elmahrek added a comment - We'll have to use deprecated minicluster classes for MR for now because of HADOOP-10056 .
          Hide
          Jarek Jarcec Cecho added a comment -

          I think that using deprecated classes for integration tests should be fine for the time being Abraham Elmahrek.

          Show
          Jarek Jarcec Cecho added a comment - I think that using deprecated classes for integration tests should be fine for the time being Abraham Elmahrek .
          Abraham Elmahrek made changes -
          Attachment SQOOP-927.1.patch [ 12609081 ]
          Hide
          Sqoop QA bot added a comment -

          Here are the results of testing the latest attachment
          https://issues.apache.org/jira/secure/attachment/12609081/SQOOP-927.1.patch against branch sqoop2.

          Overall: +1 all checks pass

          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch add/modify test case
          SUCCESS: Patch compiled
          SUCCESS: All tests passed

          Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/172/console

          This message is automatically generated.

          Show
          Sqoop QA bot added a comment - Here are the results of testing the latest attachment https://issues.apache.org/jira/secure/attachment/12609081/SQOOP-927.1.patch against branch sqoop2. Overall: +1 all checks pass SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch add/modify test case SUCCESS: Patch compiled SUCCESS: All tests passed Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/172/console This message is automatically generated.
          Hide
          Abraham Elmahrek added a comment -

          Rebase with latest

          Show
          Abraham Elmahrek added a comment - Rebase with latest
          Abraham Elmahrek made changes -
          Attachment SQOOP-927.2.patch [ 12609725 ]
          Hide
          Sqoop QA bot added a comment -

          Here are the results of testing the latest attachment
          https://issues.apache.org/jira/secure/attachment/12609725/SQOOP-927.2.patch against branch sqoop2.

          Overall: +1 all checks pass

          SUCCESS: Clean was successful
          SUCCESS: Patch applied correctly
          SUCCESS: Patch add/modify test case
          SUCCESS: Patch compiled
          SUCCESS: All tests passed

          Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/175/console

          This message is automatically generated.

          Show
          Sqoop QA bot added a comment - Here are the results of testing the latest attachment https://issues.apache.org/jira/secure/attachment/12609725/SQOOP-927.2.patch against branch sqoop2. Overall: +1 all checks pass SUCCESS: Clean was successful SUCCESS: Patch applied correctly SUCCESS: Patch add/modify test case SUCCESS: Patch compiled SUCCESS: All tests passed Console output: https://builds.apache.org/job/PreCommit-SQOOP-Build/175/console This message is automatically generated.
          Hide
          ASF subversion and git services added a comment -

          Commit 39eb1e56d3898ed5663a58b319e5055109d3b7d2 in branch refs/heads/sqoop2 from Jarek Jarcec Cecho
          [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=39eb1e5 ]

          SQOOP-927: Sqoop2: Integration: Mapreduce specific tests should be running on MiniCluster

          (Abraham Elmahrek via Jarek Jarcec Cecho)

          Show
          ASF subversion and git services added a comment - Commit 39eb1e56d3898ed5663a58b319e5055109d3b7d2 in branch refs/heads/sqoop2 from Jarek Jarcec Cecho [ https://git-wip-us.apache.org/repos/asf?p=sqoop.git;h=39eb1e5 ] SQOOP-927 : Sqoop2: Integration: Mapreduce specific tests should be running on MiniCluster (Abraham Elmahrek via Jarek Jarcec Cecho)
          Hide
          Jarek Jarcec Cecho added a comment -

          Thank you Abraham Elmahrek for your contribution!

          Show
          Jarek Jarcec Cecho added a comment - Thank you Abraham Elmahrek for your contribution!
          Jarek Jarcec Cecho made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 1.99.4 [ 12324987 ]
          Fix Version/s 2.0.0 [ 12319272 ]
          Resolution Fixed [ 1 ]
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop2-hadoop100 #589 (See https://builds.apache.org/job/Sqoop2-hadoop100/589/)
          SQOOP-927: Sqoop2: Integration: Mapreduce specific tests should be running on MiniCluster (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=39eb1e56d3898ed5663a58b319e5055109d3b7d2)

          • test/src/main/java/org/apache/sqoop/test/utils/HdfsUtils.java
          • test/src/main/java/org/apache/sqoop/test/testcases/TomcatTestCase.java
          • test/src/main/java/org/apache/sqoop/test/hadoop/HadoopRunnerFactory.java
          • test/src/main/java/org/apache/sqoop/test/hadoop/HadoopRunner.java
          • pom.xml
          • test/src/main/java/org/apache/sqoop/test/hadoop/HadoopMiniClusterRunner.java
          • test/src/main/java/org/apache/sqoop/test/asserts/HdfsAsserts.java
          • test/src/main/java/org/apache/sqoop/test/testcases/ConnectorTestCase.java
          • test/src/main/java/org/apache/sqoop/test/hadoop/HadoopLocalRunner.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop2-hadoop100 #589 (See https://builds.apache.org/job/Sqoop2-hadoop100/589/ ) SQOOP-927 : Sqoop2: Integration: Mapreduce specific tests should be running on MiniCluster (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=39eb1e56d3898ed5663a58b319e5055109d3b7d2 ) test/src/main/java/org/apache/sqoop/test/utils/HdfsUtils.java test/src/main/java/org/apache/sqoop/test/testcases/TomcatTestCase.java test/src/main/java/org/apache/sqoop/test/hadoop/HadoopRunnerFactory.java test/src/main/java/org/apache/sqoop/test/hadoop/HadoopRunner.java pom.xml test/src/main/java/org/apache/sqoop/test/hadoop/HadoopMiniClusterRunner.java test/src/main/java/org/apache/sqoop/test/asserts/HdfsAsserts.java test/src/main/java/org/apache/sqoop/test/testcases/ConnectorTestCase.java test/src/main/java/org/apache/sqoop/test/hadoop/HadoopLocalRunner.java
          Hide
          Hudson added a comment -

          SUCCESS: Integrated in Sqoop2-hadoop200 #523 (See https://builds.apache.org/job/Sqoop2-hadoop200/523/)
          SQOOP-927: Sqoop2: Integration: Mapreduce specific tests should be running on MiniCluster (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=39eb1e56d3898ed5663a58b319e5055109d3b7d2)

          • test/src/main/java/org/apache/sqoop/test/testcases/TomcatTestCase.java
          • test/src/main/java/org/apache/sqoop/test/hadoop/HadoopRunner.java
          • test/src/main/java/org/apache/sqoop/test/hadoop/HadoopMiniClusterRunner.java
          • test/src/main/java/org/apache/sqoop/test/asserts/HdfsAsserts.java
          • test/src/main/java/org/apache/sqoop/test/utils/HdfsUtils.java
          • test/src/main/java/org/apache/sqoop/test/hadoop/HadoopRunnerFactory.java
          • pom.xml
          • test/src/main/java/org/apache/sqoop/test/testcases/ConnectorTestCase.java
          • test/src/main/java/org/apache/sqoop/test/hadoop/HadoopLocalRunner.java
          Show
          Hudson added a comment - SUCCESS: Integrated in Sqoop2-hadoop200 #523 (See https://builds.apache.org/job/Sqoop2-hadoop200/523/ ) SQOOP-927 : Sqoop2: Integration: Mapreduce specific tests should be running on MiniCluster (jarcec: https://git-wip-us.apache.org/repos/asf?p=sqoop.git&a=commit&h=39eb1e56d3898ed5663a58b319e5055109d3b7d2 ) test/src/main/java/org/apache/sqoop/test/testcases/TomcatTestCase.java test/src/main/java/org/apache/sqoop/test/hadoop/HadoopRunner.java test/src/main/java/org/apache/sqoop/test/hadoop/HadoopMiniClusterRunner.java test/src/main/java/org/apache/sqoop/test/asserts/HdfsAsserts.java test/src/main/java/org/apache/sqoop/test/utils/HdfsUtils.java test/src/main/java/org/apache/sqoop/test/hadoop/HadoopRunnerFactory.java pom.xml test/src/main/java/org/apache/sqoop/test/testcases/ConnectorTestCase.java test/src/main/java/org/apache/sqoop/test/hadoop/HadoopLocalRunner.java

            People

            • Assignee:
              Abraham Elmahrek
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development