Sqoop
  1. Sqoop
  2. SQOOP-433

Tests are failing on current 0.23 version

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 1.4.1-incubating
    • Fix Version/s: 1.4.1-incubating
    • Component/s: None
    • Labels:
      None

      Description

      We're currently failing most of out test cases on hadoop version 0.23 on following Exception:

      java.lang.IllegalStateException: Variable substitution depth too large: 20 $

      {fs.default.name}

      at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:561)
      at org.apache.hadoop.conf.Configuration.get(Configuration.java:579)
      at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1057)
      at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
      at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
      at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1221)
      at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1218)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:396)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1177)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:1218)
      at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1239)
      at org.apache.sqoop.mapreduce.ImportJobBase.runJob(ImportJobBase.java:141)
      at org.apache.sqoop.mapreduce.ImportJobBase.runImport(ImportJobBase.java:201)
      at org.apache.sqoop.manager.SqlManager.importTable(SqlManager.java:413)
      at org.apache.sqoop.tool.ImportTool.importTable(ImportTool.java:380)
      at org.apache.sqoop.tool.ImportAllTablesTool.run(ImportAllTablesTool.java:64)
      at org.apache.sqoop.Sqoop.run(Sqoop.java:145)
      at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:69)
      at org.apache.sqoop.Sqoop.runSqoop(Sqoop.java:181)
      at com.cloudera.sqoop.Sqoop.runSqoop(Sqoop.java:45)
      at com.cloudera.sqoop.testutil.ImportJobTestCase.runImport(ImportJobTestCase.java:215)
      at com.cloudera.sqoop.TestAllTables.testMultiTableImport(TestAllTables.java:109)
      at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
      at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
      at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
      at java.lang.reflect.Method.invoke(Method.java:597)
      at junit.framework.TestCase.runTest(TestCase.java:168)
      at junit.framework.TestCase.runBare(TestCase.java:134)
      at junit.framework.TestResult$1.protect(TestResult.java:110)
      at junit.framework.TestResult.runProtected(TestResult.java:128)
      at junit.framework.TestResult.run(TestResult.java:113)
      at junit.framework.TestCase.run(TestCase.java:124)
      at junit.framework.TestSuite.runTest(TestSuite.java:243)
      at junit.framework.TestSuite.run(TestSuite.java:238)
      at org.junit.internal.runners.JUnit38ClassRunner.run(JUnit38ClassRunner.java:83)
      at junit.framework.JUnit4TestAdapter.run(JUnit4TestAdapter.java:39)
      at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.run(JUnitTestRunner.java:422)
      at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.launch(JUnitTestRunner.java:931)
      at org.apache.tools.ant.taskdefs.optional.junit.JUnitTestRunner.main(JUnitTestRunner.java:785)

      1. SQOOP-433.path
        0.7 kB
        Jarek Jarcec Cecho
      2. SQOOP-433.path
        0.7 kB
        Jarek Jarcec Cecho

        Issue Links

          Activity

          Hide
          jiraposter@reviews.apache.org added a comment -

          -----------------------------------------------------------
          This is an automatically generated e-mail. To reply, visit:
          https://reviews.apache.org/r/3736/
          -----------------------------------------------------------

          Review request for Sqoop, Arvind Prabhakar and Bilung Lee.

          Summary
          -------

          I've tried most simple change to get it working, however I'm not sure how dirty this solution is or whether it's even acceptable.

          This addresses bug SQOOP-433.
          https://issues.apache.org/jira/browse/SQOOP-433

          Diffs


          /build.xml 1239338

          Diff: https://reviews.apache.org/r/3736/diff

          Testing
          -------

          All supported versions went fine:

          ant -Dhadoopversion=20 test
          ant -Dhadoopversion=23 test
          ant -Dhadoopversion=100 test

          Thanks,

          Jarek

          Show
          jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3736/ ----------------------------------------------------------- Review request for Sqoop, Arvind Prabhakar and Bilung Lee. Summary ------- I've tried most simple change to get it working, however I'm not sure how dirty this solution is or whether it's even acceptable. This addresses bug SQOOP-433 . https://issues.apache.org/jira/browse/SQOOP-433 Diffs /build.xml 1239338 Diff: https://reviews.apache.org/r/3736/diff Testing ------- All supported versions went fine: ant -Dhadoopversion=20 test ant -Dhadoopversion=23 test ant -Dhadoopversion=100 test Thanks, Jarek
          Hide
          jiraposter@reviews.apache.org added a comment -

          -----------------------------------------------------------
          This is an automatically generated e-mail. To reply, visit:
          https://reviews.apache.org/r/3736/#review4783
          -----------------------------------------------------------

          Thanks for the patch, Jarcec. Just one nit below.

          /build.xml
          <https://reviews.apache.org/r/3736/#comment10515>

          It would be nice if you could make the comment a bit clearer, something like, "Set to an empty string below due to MAPREDUCE-3736"

          • Bilung

          On 2012-02-02 17:44:27, Jarek Cecho wrote:

          -----------------------------------------------------------

          This is an automatically generated e-mail. To reply, visit:

          https://reviews.apache.org/r/3736/

          -----------------------------------------------------------

          (Updated 2012-02-02 17:44:27)

          Review request for Sqoop, Arvind Prabhakar and Bilung Lee.

          Summary

          -------

          I've tried most simple change to get it working, however I'm not sure how dirty this solution is or whether it's even acceptable.

          This addresses bug SQOOP-433.

          https://issues.apache.org/jira/browse/SQOOP-433

          Diffs

          -----

          /build.xml 1239338

          Diff: https://reviews.apache.org/r/3736/diff

          Testing

          -------

          All supported versions went fine:

          ant -Dhadoopversion=20 test

          ant -Dhadoopversion=23 test

          ant -Dhadoopversion=100 test

          Thanks,

          Jarek

          Show
          jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3736/#review4783 ----------------------------------------------------------- Thanks for the patch, Jarcec. Just one nit below. /build.xml < https://reviews.apache.org/r/3736/#comment10515 > It would be nice if you could make the comment a bit clearer, something like, "Set to an empty string below due to MAPREDUCE-3736 " Bilung On 2012-02-02 17:44:27, Jarek Cecho wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3736/ ----------------------------------------------------------- (Updated 2012-02-02 17:44:27) Review request for Sqoop, Arvind Prabhakar and Bilung Lee. Summary ------- I've tried most simple change to get it working, however I'm not sure how dirty this solution is or whether it's even acceptable. This addresses bug SQOOP-433 . https://issues.apache.org/jira/browse/SQOOP-433 Diffs ----- /build.xml 1239338 Diff: https://reviews.apache.org/r/3736/diff Testing ------- All supported versions went fine: ant -Dhadoopversion=20 test ant -Dhadoopversion=23 test ant -Dhadoopversion=100 test Thanks, Jarek
          Hide
          jiraposter@reviews.apache.org added a comment -

          -----------------------------------------------------------
          This is an automatically generated e-mail. To reply, visit:
          https://reviews.apache.org/r/3736/
          -----------------------------------------------------------

          (Updated 2012-02-03 06:06:41.677466)

          Review request for Sqoop, Arvind Prabhakar and Bilung Lee.

          Changes
          -------

          Thank you Bilung for your feedback, I've changed the comment per your suggestion.

          Jarcec

          Summary
          -------

          I've tried most simple change to get it working, however I'm not sure how dirty this solution is or whether it's even acceptable.

          This addresses bug SQOOP-433.
          https://issues.apache.org/jira/browse/SQOOP-433

          Diffs (updated)


          /build.xml 1239772

          Diff: https://reviews.apache.org/r/3736/diff

          Testing
          -------

          All supported versions went fine:

          ant -Dhadoopversion=20 test
          ant -Dhadoopversion=23 test
          ant -Dhadoopversion=100 test

          Thanks,

          Jarek

          Show
          jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3736/ ----------------------------------------------------------- (Updated 2012-02-03 06:06:41.677466) Review request for Sqoop, Arvind Prabhakar and Bilung Lee. Changes ------- Thank you Bilung for your feedback, I've changed the comment per your suggestion. Jarcec Summary ------- I've tried most simple change to get it working, however I'm not sure how dirty this solution is or whether it's even acceptable. This addresses bug SQOOP-433 . https://issues.apache.org/jira/browse/SQOOP-433 Diffs (updated) /build.xml 1239772 Diff: https://reviews.apache.org/r/3736/diff Testing ------- All supported versions went fine: ant -Dhadoopversion=20 test ant -Dhadoopversion=23 test ant -Dhadoopversion=100 test Thanks, Jarek
          Hide
          jiraposter@reviews.apache.org added a comment -

          -----------------------------------------------------------
          This is an automatically generated e-mail. To reply, visit:
          https://reviews.apache.org/r/3736/
          -----------------------------------------------------------

          (Updated 2012-02-03 06:07:51.772929)

          Review request for Sqoop, Arvind Prabhakar and Bilung Lee.

          Summary
          -------

          I've tried most simple change to get it working, however I'm not sure how dirty this solution is or whether it's even acceptable.

          This addresses bug SQOOP-433.
          https://issues.apache.org/jira/browse/SQOOP-433

          Diffs (updated)


          /build.xml 1239772

          Diff: https://reviews.apache.org/r/3736/diff

          Testing
          -------

          All supported versions went fine:

          ant -Dhadoopversion=20 test
          ant -Dhadoopversion=23 test
          ant -Dhadoopversion=100 test

          Thanks,

          Jarek

          Show
          jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3736/ ----------------------------------------------------------- (Updated 2012-02-03 06:07:51.772929) Review request for Sqoop, Arvind Prabhakar and Bilung Lee. Summary ------- I've tried most simple change to get it working, however I'm not sure how dirty this solution is or whether it's even acceptable. This addresses bug SQOOP-433 . https://issues.apache.org/jira/browse/SQOOP-433 Diffs (updated) /build.xml 1239772 Diff: https://reviews.apache.org/r/3736/diff Testing ------- All supported versions went fine: ant -Dhadoopversion=20 test ant -Dhadoopversion=23 test ant -Dhadoopversion=100 test Thanks, Jarek
          Hide
          Arvind Prabhakar added a comment -

          Patch committed to trunk and branch-1.4.1. Thanks Jarcec!

          Show
          Arvind Prabhakar added a comment - Patch committed to trunk and branch-1.4.1. Thanks Jarcec!
          Hide
          jiraposter@reviews.apache.org added a comment -

          -----------------------------------------------------------
          This is an automatically generated e-mail. To reply, visit:
          https://reviews.apache.org/r/3736/#review4801
          -----------------------------------------------------------

          Ship it!

          +1

          • Arvind

          On 2012-02-03 06:07:51, Jarek Cecho wrote:

          -----------------------------------------------------------

          This is an automatically generated e-mail. To reply, visit:

          https://reviews.apache.org/r/3736/

          -----------------------------------------------------------

          (Updated 2012-02-03 06:07:51)

          Review request for Sqoop, Arvind Prabhakar and Bilung Lee.

          Summary

          -------

          I've tried most simple change to get it working, however I'm not sure how dirty this solution is or whether it's even acceptable.

          This addresses bug SQOOP-433.

          https://issues.apache.org/jira/browse/SQOOP-433

          Diffs

          -----

          /build.xml 1239772

          Diff: https://reviews.apache.org/r/3736/diff

          Testing

          -------

          All supported versions went fine:

          ant -Dhadoopversion=20 test

          ant -Dhadoopversion=23 test

          ant -Dhadoopversion=100 test

          Thanks,

          Jarek

          Show
          jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3736/#review4801 ----------------------------------------------------------- Ship it! +1 Arvind On 2012-02-03 06:07:51, Jarek Cecho wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3736/ ----------------------------------------------------------- (Updated 2012-02-03 06:07:51) Review request for Sqoop, Arvind Prabhakar and Bilung Lee. Summary ------- I've tried most simple change to get it working, however I'm not sure how dirty this solution is or whether it's even acceptable. This addresses bug SQOOP-433 . https://issues.apache.org/jira/browse/SQOOP-433 Diffs ----- /build.xml 1239772 Diff: https://reviews.apache.org/r/3736/diff Testing ------- All supported versions went fine: ant -Dhadoopversion=20 test ant -Dhadoopversion=23 test ant -Dhadoopversion=100 test Thanks, Jarek
          Hide
          Hudson added a comment -

          Integrated in Sqoop-ant-jdk-1.6 #83 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6/83/)
          SQOOP-433. Tests are failing on current 0.23 version.

          (Jarcec Cecho via Arvind Prabhakar)

          arvind : http://svn.apache.org/viewvc/?view=rev&rev=1240208
          Files :

          • /incubator/sqoop/trunk/build.xml
          Show
          Hudson added a comment - Integrated in Sqoop-ant-jdk-1.6 #83 (See https://builds.apache.org/job/Sqoop-ant-jdk-1.6/83/ ) SQOOP-433 . Tests are failing on current 0.23 version. (Jarcec Cecho via Arvind Prabhakar) arvind : http://svn.apache.org/viewvc/?view=rev&rev=1240208 Files : /incubator/sqoop/trunk/build.xml

            People

            • Assignee:
              Jarek Jarcec Cecho
              Reporter:
              Jarek Jarcec Cecho
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development