Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Blocker Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.23.0
    • Fix Version/s: 0.23.1
    • Component/s: mrv2, test
    • Labels:
    • Target Version/s:
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Fixed failing JUnit tests in Gridmix.
    • Tags:
      junit test

      Description

      When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:

      java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
              at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
              at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
              at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
              at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
              at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
              at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
              at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
              at java.security.AccessController.doPrivileged(Native Method)
              at javax.security.auth.Subject.doAs(Subject.java:396)
              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
              at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
              at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
              at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
              at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
              at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
              at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
              at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
              at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
              at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
              at java.security.AccessController.doPrivileged(Native Method)
              at javax.security.auth.Subject.doAs(Subject.java:396)
              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
              at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
      
      1. 3462.trunk.patch
        4 kB
        Ravi Gummadi
      2. MAPREDUCE-3462.branch-0.23.patch
        3 kB
        Ravi Prakash

        Issue Links

          Activity

          Amar Kamat created issue -
          Amar Kamat made changes -
          Field Original Value New Value
          Link This issue relates to MAPREDUCE-3168 [ MAPREDUCE-3168 ]
          Amar Kamat made changes -
          Priority Major [ 3 ] Blocker [ 1 ]
          Ravi Prakash made changes -
          Assignee Ravi Prakash [ raviprak ]
          Ravi Prakash made changes -
          Attachment MAPREDUCE-3462.branch-0.23.patch [ 12508428 ]
          Ravi Prakash made changes -
          Fix Version/s 0.24.0 [ 12317654 ]
          Affects Version/s 0.23.0 [ 12315570 ]
          Affects Version/s 0.24.0 [ 12317654 ]
          Target Version/s 0.24.0 [ 12317654 ] 0.23.1 [ 12318883 ]
          Description When I run JUnit tests (e.g. TestGridmixSubmission), I see job submission failing with the following error:
          {noformat}
          java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
                  at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
                  at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
                  at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
                  at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
                  at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
                  at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
                  at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
                  at java.security.AccessController.doPrivileged(Native Method)
                  at javax.security.auth.Subject.doAs(Subject.java:396)
                  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
                  at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
                  at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
                  at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
                  at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
                  at java.security.AccessController.doPrivileged(Native Method)
                  at javax.security.auth.Subject.doAs(Subject.java:396)
                  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
          {noformat}
          When I run JUnit tests (e.g. TestDistCacheEmulation, TestSleepJob and TestCompressionEmulationUtils), I see job submission failing with the following error:
          {noformat}
          java.lang.IllegalStateException: Variable substitution depth too large: 20 ${fs.default.name}
                  at org.apache.hadoop.conf.Configuration.substituteVars(Configuration.java:551)
                  at org.apache.hadoop.conf.Configuration.get(Configuration.java:569)
                  at org.apache.hadoop.conf.Configuration.getStrings(Configuration.java:1020)
                  at org.apache.hadoop.mapreduce.JobSubmitter.populateTokenCache(JobSubmitter.java:564)
                  at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:353)
                  at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1159)
                  at org.apache.hadoop.mapreduce.Job$2.run(Job.java:1156)
                  at java.security.AccessController.doPrivileged(Native Method)
                  at javax.security.auth.Subject.doAs(Subject.java:396)
                  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
                  at org.apache.hadoop.mapreduce.Job.submit(Job.java:1156)
                  at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1176)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.launchGridmixJob(Gridmix.java:190)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.writeInputData(Gridmix.java:150)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.start(Gridmix.java:425)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.runJob(Gridmix.java:380)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.access$000(Gridmix.java:56)
                  at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:313)
                  at org.apache.hadoop.mapred.gridmix.Gridmix$1.run(Gridmix.java:311)
                  at java.security.AccessController.doPrivileged(Native Method)
                  at javax.security.auth.Subject.doAs(Subject.java:396)
                  at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1152)
                  at org.apache.hadoop.mapred.gridmix.Gridmix.run(Gridmix.java:311)
          {noformat}
          Ravi Prakash made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Ravi Prakash made changes -
          Component/s mrv2 [ 12314301 ]
          Ravi Gummadi made changes -
          Attachment 3462.trunk.patch [ 12508507 ]
          Amar Kamat made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Release Note Fixed failing JUnit tests in Gridmix.
          Fix Version/s 0.23.1 [ 12318883 ]
          Fix Version/s 0.24.0 [ 12317654 ]
          Resolution Fixed [ 1 ]
          Vinod Kumar Vavilapalli made changes -
          Fix Version/s 0.24.0 [ 12317654 ]
          Arun C Murthy made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Ravi Prakash
              Reporter:
              Amar Kamat
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development