Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3462

Job submission failing in JUnit tests

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.23.0
    • 0.23.1
    • mrv2, test
    • Reviewed
    • Fixed failing JUnit tests in Gridmix.
    • junit test

    Description

      When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:

      java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
              at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
              at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
              at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
              at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
              at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
              at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
              at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
              at java.security.AccessController.doPrivileged(Native Method)
              at javax.security.auth.Subject.doAs(Subject.java:396)
              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
              at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
              at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
              at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
              at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
              at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
              at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
              at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
              at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
              at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
              at java.security.AccessController.doPrivileged(Native Method)
              at javax.security.auth.Subject.doAs(Subject.java:396)
              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
              at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
      

      Attachments

        1. 3462.trunk.patch
          4 kB
          Ravi Gummadi
        2. MAPREDUCE-3462.branch-0.23.patch
          3 kB
          Ravi Prakash

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            raviprak Ravi Prakash
            amar_kamat Amar Kamat
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment