Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1421

LinuxTaskController tests failing on trunk after the commit of MAPREDUCE-1385

    Details

    • Hadoop Flags:
      Reviewed

      Description

      The following tests fail, in particular:

      • TestDebugScriptWithLinuxTaskController
      • TestJobExecutionAsDifferentUser
      • TestPipesAsDifferentUser
      • TestKillSubProcessesWithLinuxTaskController
      1. TestJobExecutionAsDifferentUser.patch
        5 kB
        Devaraj Das
      2. patch-1421-ydist.txt
        20 kB
        Amareshwari Sriramadasu
      3. patch-1421-2.txt
        24 kB
        Amareshwari Sriramadasu
      4. patch-1421-1-ydist.txt
        22 kB
        Amareshwari Sriramadasu
      5. patch-1421-1.txt
        10 kB
        Amareshwari Sriramadasu
      6. patch-1421.txt
        5 kB
        Amareshwari Sriramadasu

        Issue Links

          Activity

          Amareshwari Sriramadasu created issue -
          Hide
          Devaraj Das added a comment -

          Attaching a patch that fixes TestJobExecutionAsDifferentUser. I had missed fixing this testcase in MAPREDUCE-1385. I didn't know that I needed to run this using linux-task-controller. We should have an easier way to run all tests that use the linux-task-controller rather than having to guess that..
          TestDebugScriptWithLinuxTaskController works in my box. What exception do you see?

          Show
          Devaraj Das added a comment - Attaching a patch that fixes TestJobExecutionAsDifferentUser. I had missed fixing this testcase in MAPREDUCE-1385 . I didn't know that I needed to run this using linux-task-controller. We should have an easier way to run all tests that use the linux-task-controller rather than having to guess that.. TestDebugScriptWithLinuxTaskController works in my box. What exception do you see?
          Devaraj Das made changes -
          Field Original Value New Value
          Attachment TestJobExecutionAsDifferentUser.patch [ 12431635 ]
          Hide
          Amareshwari Sriramadasu added a comment -

          There is no exception in the test TestDebugScriptWithLinuxTaskController. It fails with following assertion failure when i run with -Dtaskcontroller-ugi=nobody,nobody.

          Testcase: testDebugScriptExecutionAsDifferentUser took 18.307 sec
          	FAILED
          Path /home/amarsri/workspace/trunk/build/test/logs/userlogs/attempt_20100127150051180_0001_m_000000_0/debugout is group owned not by nobody but by users
          junit.framework.AssertionFailedError: Path /home/amarsri/workspace/trunk/build/test/logs/userlogs/attempt_20100127150051180_0001_m_000000_0/debugout is group owned not by nobody but by users
          	at org.apache.hadoop.mapred.TestTaskTrackerLocalization.checkFilePermissions(TestTaskTrackerLocalization.java:291)
          	at org.apache.hadoop.mapred.TestDebugScript.verifyDebugScriptOutput(TestDebugScript.java:166)
          	at org.apache.hadoop.mapred.TestDebugScriptWithLinuxTaskController.testDebugScriptExecutionAsDifferentUser(TestDebugScriptWithLinuxTaskController.java:61)
          
          Show
          Amareshwari Sriramadasu added a comment - There is no exception in the test TestDebugScriptWithLinuxTaskController. It fails with following assertion failure when i run with -Dtaskcontroller-ugi=nobody,nobody. Testcase: testDebugScriptExecutionAsDifferentUser took 18.307 sec FAILED Path /home/amarsri/workspace/trunk/build/test/logs/userlogs/attempt_20100127150051180_0001_m_000000_0/debugout is group owned not by nobody but by users junit.framework.AssertionFailedError: Path /home/amarsri/workspace/trunk/build/test/logs/userlogs/attempt_20100127150051180_0001_m_000000_0/debugout is group owned not by nobody but by users at org.apache.hadoop.mapred.TestTaskTrackerLocalization.checkFilePermissions(TestTaskTrackerLocalization.java:291) at org.apache.hadoop.mapred.TestDebugScript.verifyDebugScriptOutput(TestDebugScript.java:166) at org.apache.hadoop.mapred.TestDebugScriptWithLinuxTaskController.testDebugScriptExecutionAsDifferentUser(TestDebugScriptWithLinuxTaskController.java:61)
          Hide
          Amareshwari Sriramadasu added a comment -

          Looks like the validation itself is wrong in TestDebugScript:

          -      String ttGroup = UnixUserGroupInformation.login().getGroupNames()[0];
          +      Groups groups = new Groups(new Configuration());
          +      String ttGroup = groups.getGroups(expectedUser).get(0);
          

          The above code should look at group of the getCurrentUser(), not expectedUser.

          Show
          Amareshwari Sriramadasu added a comment - Looks like the validation itself is wrong in TestDebugScript: - String ttGroup = UnixUserGroupInformation.login().getGroupNames()[0]; + Groups groups = new Groups( new Configuration()); + String ttGroup = groups.getGroups(expectedUser).get(0); The above code should look at group of the getCurrentUser(), not expectedUser.
          Hide
          Amareshwari Sriramadasu added a comment -

          Updated Devaraj's patch for TestDebugScript to look at currentUser's group in the verification.

          Both the tests passed on my machine.

          Show
          Amareshwari Sriramadasu added a comment - Updated Devaraj's patch for TestDebugScript to look at currentUser's group in the verification. Both the tests passed on my machine.
          Amareshwari Sriramadasu made changes -
          Attachment patch-1421.txt [ 12431638 ]
          Hide
          Amareshwari Sriramadasu added a comment -

          Submitting for hudson

          Show
          Amareshwari Sriramadasu added a comment - Submitting for hudson
          Amareshwari Sriramadasu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Vinod Kumar Vavilapalli added a comment -

          We should have an easier way to run all tests that use the linux-task-controller rather than having to guess that.

          While these tests were originally checked in, we argued fiercely for and against having a separate ant target to run just these tests and eventually didn't add one. Time we get one in, keeping in view all the recent history of these tests?

          Show
          Vinod Kumar Vavilapalli added a comment - We should have an easier way to run all tests that use the linux-task-controller rather than having to guess that. While these tests were originally checked in, we argued fiercely for and against having a separate ant target to run just these tests and eventually didn't add one. Time we get one in, keeping in view all the recent history of these tests?
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12431638/patch-1421.txt
          against trunk revision 903563.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 6 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed core unit tests.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/291/testReport/
          Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/291/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/291/artifact/trunk/build/test/checkstyle-errors.html
          Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/291/console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12431638/patch-1421.txt against trunk revision 903563. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 6 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/291/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/291/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/291/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/291/console This message is automatically generated.
          Hide
          Ravi Gummadi added a comment -

          TestPipesAsDifferentUser is also failing with the following:

          Output part-file's owner is not correct. Expected : user1 Found : user2
          junit.framework.AssertionFailedError: Output part-file's owner is not correct. Expected : ravi_tmp Found : gravi
          at org.apache.hadoop.mapred.ClusterWithLinuxTaskController.assertOwnerShip(ClusterWithLinuxTaskController.java:318)
          at org.apache.hadoop.mapred.ClusterWithLinuxTaskController.assertOwnerShip(ClusterWithLinuxTaskController.java:298)
          at org.apache.hadoop.mapred.pipes.TestPipesAsDifferentUser.runPipesJobAsUser(TestPipesAsDifferentUser.java:76)
          at org.apache.hadoop.mapred.pipes.TestPipesAsDifferentUser.testPipes(TestPipesAsDifferentUser.java:47)

          Show
          Ravi Gummadi added a comment - TestPipesAsDifferentUser is also failing with the following: Output part-file's owner is not correct. Expected : user1 Found : user2 junit.framework.AssertionFailedError: Output part-file's owner is not correct. Expected : ravi_tmp Found : gravi at org.apache.hadoop.mapred.ClusterWithLinuxTaskController.assertOwnerShip(ClusterWithLinuxTaskController.java:318) at org.apache.hadoop.mapred.ClusterWithLinuxTaskController.assertOwnerShip(ClusterWithLinuxTaskController.java:298) at org.apache.hadoop.mapred.pipes.TestPipesAsDifferentUser.runPipesJobAsUser(TestPipesAsDifferentUser.java:76) at org.apache.hadoop.mapred.pipes.TestPipesAsDifferentUser.testPipes(TestPipesAsDifferentUser.java:47)
          Ravi Gummadi made changes -
          Link This issue blocks MAPREDUCE-890 [ MAPREDUCE-890 ]
          Vinod Kumar Vavilapalli made changes -
          Component/s task-controller [ 12313272 ]
          Amareshwari Sriramadasu made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Amareshwari Sriramadasu added a comment -

          Patch fixing TestPipes also

          Show
          Amareshwari Sriramadasu added a comment - Patch fixing TestPipes also
          Amareshwari Sriramadasu made changes -
          Attachment patch-1421-1.txt [ 12431760 ]
          Amareshwari Sriramadasu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12431760/patch-1421-1.txt
          against trunk revision 904397.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 14 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          -1 core tests. The patch failed core unit tests.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/294/testReport/
          Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/294/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/294/artifact/trunk/build/test/checkstyle-errors.html
          Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/294/console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12431760/patch-1421-1.txt against trunk revision 904397. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 14 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. -1 core tests. The patch failed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/294/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/294/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/294/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h3.grid.sp2.yahoo.net/294/console This message is automatically generated.
          Hide
          Amareshwari Sriramadasu added a comment -

          -1 core tests.

          Is due to MAPREDUCE-1412

          Show
          Amareshwari Sriramadasu added a comment - -1 core tests. Is due to MAPREDUCE-1412
          Hide
          Vinod Kumar Vavilapalli added a comment -

          Looked at the patch. It has missed some cases:

          • TestKillSubProcessesWithLinuxTaskController will also fail, but only if the group-owner of the binary is TT's non-primary group (which is typically the clusters' setup).
          • TestJobExecutionAsDifferentUser.testTimeoutStackTrace() has to run the job as proxy user.

          To help future tests, should we describe in the javadoc of ClusterWithLinuxTaskController as to how one should run jobs as other users in the tests?

          Can we also change the remaining "/testing/" paths in TestPipes to "testing/" so that we are consistent throughout the test-case?

          Show
          Vinod Kumar Vavilapalli added a comment - Looked at the patch. It has missed some cases: TestKillSubProcessesWithLinuxTaskController will also fail, but only if the group-owner of the binary is TT's non-primary group (which is typically the clusters' setup). TestJobExecutionAsDifferentUser.testTimeoutStackTrace() has to run the job as proxy user. To help future tests, should we describe in the javadoc of ClusterWithLinuxTaskController as to how one should run jobs as other users in the tests? Can we also change the remaining "/testing/" paths in TestPipes to "testing/" so that we are consistent throughout the test-case?
          Vinod Kumar Vavilapalli made changes -
          Summary TestDebugScriptWithLinuxTaskController and TestJobExecutionAsDifferentUser fail on trunk LinuxTaskController tests failing on trunk after the commit of MAPREDUCE-1385
          Assignee Amareshwari Sriramadasu [ amareshwari ]
          Description TestDebugScriptWithLinuxTaskController and TestJobExecutionAsDifferentUser fail on trunk after the commit of MAPREDUCE-1385 The following tests fail, in particular:
           - TestDebugScriptWithLinuxTaskController
           - TestJobExecutionAsDifferentUser
           - TestPipesAsDifferentUser
           - TestKillSubProcessesWithLinuxTaskController
          Amareshwari Sriramadasu made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Hide
          Amareshwari Sriramadasu added a comment -

          Patch incorporates review comments.

          TestKillSubProcessesWithLinuxTaskController will also fail, but only if the group-owner of the binary is TT's non-primary group (which is typically the clusters' setup).

          For running the tests with group-owner of the binary as secondary group of the test-runner needs a changes in ClusterWithLinuxTaskController after MAPREDUCE-899. Patches does these changes.

          Ran all LinuxTaskController tests with group-owner of the binary as secondary group of the test-runner. All tests passed except TestStreamingAsDifferentUser.
          TestStreamingAsDiffirentUser fails saying "Failed to specify server's Kerberos principal name". This failure is because the configuration "hadoop.security.authentication" is not picked up as "simple" from src/test/mapred-site.xml. This should be fixed by HADOOP-6538. If not, i will raise a jira and fix this.

          Show
          Amareshwari Sriramadasu added a comment - Patch incorporates review comments. TestKillSubProcessesWithLinuxTaskController will also fail, but only if the group-owner of the binary is TT's non-primary group (which is typically the clusters' setup). For running the tests with group-owner of the binary as secondary group of the test-runner needs a changes in ClusterWithLinuxTaskController after MAPREDUCE-899 . Patches does these changes. Ran all LinuxTaskController tests with group-owner of the binary as secondary group of the test-runner. All tests passed except TestStreamingAsDifferentUser. TestStreamingAsDiffirentUser fails saying "Failed to specify server's Kerberos principal name". This failure is because the configuration "hadoop.security.authentication" is not picked up as "simple" from src/test/mapred-site.xml. This should be fixed by HADOOP-6538 . If not, i will raise a jira and fix this.
          Amareshwari Sriramadasu made changes -
          Attachment patch-1421-2.txt [ 12434785 ]
          Amareshwari Sriramadasu made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Hide
          Amareshwari Sriramadasu added a comment -

          All tests passed except TestStreamingAsDifferentUser.

          I verified the test TestStreamingAsDifferentUser passes by explicitly setting hadoop.security.authentication to simple.

          Show
          Amareshwari Sriramadasu added a comment - All tests passed except TestStreamingAsDifferentUser. I verified the test TestStreamingAsDifferentUser passes by explicitly setting hadoop.security.authentication to simple.
          Hide
          Vinod Kumar Vavilapalli added a comment -

          The patch looks good now, and the tests are all running fine now. +1.

          Let's wait for Hudson..

          Show
          Vinod Kumar Vavilapalli added a comment - The patch looks good now, and the tests are all running fine now. +1. Let's wait for Hudson..
          Hide
          Hadoop QA added a comment -

          +1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12434785/patch-1421-2.txt
          against trunk revision 906228.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 34 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed core unit tests.

          +1 contrib tests. The patch passed contrib unit tests.

          Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/434/testReport/
          Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/434/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/434/artifact/trunk/build/test/checkstyle-errors.html
          Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/434/console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - +1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12434785/patch-1421-2.txt against trunk revision 906228. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 34 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. +1 contrib tests. The patch passed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/434/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/434/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/434/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h6.grid.sp2.yahoo.net/434/console This message is automatically generated.
          Hide
          Amareshwari Sriramadasu added a comment -

          I verified that patch still applies and all LinuxTaskController tests pass with the patch.

          Show
          Amareshwari Sriramadasu added a comment - I verified that patch still applies and all LinuxTaskController tests pass with the patch.
          Hide
          Amareshwari Sriramadasu added a comment -

          Ran the tests again, all the tests passed.

          Show
          Amareshwari Sriramadasu added a comment - Ran the tests again, all the tests passed.
          Hide
          Vinod Kumar Vavilapalli added a comment -

          I've just committed this to trunk. Thanks Amareshwari!

          Show
          Vinod Kumar Vavilapalli added a comment - I've just committed this to trunk. Thanks Amareshwari!
          Vinod Kumar Vavilapalli made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk-Commit #255 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/255/)
          . LinuxTaskController tests failing on trunk after the commit of MAPREDUCE-1385. Contributed by Amareshwari Sriramadasu.

          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk-Commit #255 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk-Commit/255/ ) . LinuxTaskController tests failing on trunk after the commit of MAPREDUCE-1385 . Contributed by Amareshwari Sriramadasu.
          Hide
          Amareshwari Sriramadasu added a comment -

          Patch for Yahoo! distribution

          Show
          Amareshwari Sriramadasu added a comment - Patch for Yahoo! distribution
          Amareshwari Sriramadasu made changes -
          Attachment patch-1421-ydist.txt [ 12437879 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #248 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/248/)

          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #248 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/248/ )
          Hide
          Amareshwari Sriramadasu added a comment -

          Patch for Yahoo! distribution. One file was missed in earlier patch.

          Show
          Amareshwari Sriramadasu added a comment - Patch for Yahoo! distribution. One file was missed in earlier patch.
          Amareshwari Sriramadasu made changes -
          Attachment patch-1421-1-ydist.txt [ 12437985 ]
          Tom White made changes -
          Fix Version/s 0.21.0 [ 12314045 ]
          Fix Version/s 0.22.0 [ 12314184 ]
          Tom White made changes -
          Status Resolved [ 5 ] Closed [ 6 ]

            People

            • Assignee:
              Amareshwari Sriramadasu
              Reporter:
              Amareshwari Sriramadasu
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development