Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2563

Gridmix high ram jobs emulation system tests.

    Details

    • Type: Task Task
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.23.0
    • Component/s: contrib/gridmix
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Adds system tests to test the High-Ram feature in Gridmix.

      Description

      1. Run the Gridmix with a high ram jobs trace and verify each Gridmix job whether it honors the high ram or not. In
      the trace the jobs should use the high ram for both maps and reduces.

      2. Run the Gridmix with a high ram jobs trace and verify each Gridmix job whether it honors the high ram or not. In
      the trace the jobs should use the high ram only for maps.

      3. Run the Gridmix with a high ram jobs trace and verify each Gridmix job whether it honors the high ram or not. In the
      trace the jobs should use the high ram only for reducers.

      4. Run the Gridmix with a high ram jobs trace by disabling the emulation of high ram and verify each Gridmix job
      whether it honors the high ram or not. In disable mode it should should not honor the high ram and run it as a normal
      job.

      1. MAPREDUCE-2563-v5.patch
        167 kB
        Vinay Kumar Thota
      2. MAPREDUCE-2563-v4.patch
        167 kB
        Vinay Kumar Thota
      3. MAPREDUCE-2563-v3.patch
        165 kB
        Vinay Kumar Thota
      4. MAPREDUCE-2563-v2.patch
        161 kB
        Vinay Kumar Thota
      5. MAPREDUCE-2563-v1.patch
        121 kB
        Vinay Kumar Thota
      6. MAPREDUCE-2563.patch
        115 kB
        Vinay Kumar Thota

        Activity

        Hide
        Vinay Kumar Thota added a comment -

        Please review the patch and let me know your comments.

        Show
        Vinay Kumar Thota added a comment - Please review the patch and let me know your comments.
        Hide
        Vinay Kumar Thota added a comment -

        Incorporated Amar's offline comments and uploaded the new patch.

        Show
        Vinay Kumar Thota added a comment - Incorporated Amar's offline comments and uploaded the new patch.
        Hide
        Vinay Kumar Thota added a comment -

        Addressed Amar's some more offline comments and uploaded new patch.

        Show
        Vinay Kumar Thota added a comment - Addressed Amar's some more offline comments and uploaded new patch.
        Hide
        Vinay Kumar Thota added a comment -

        Addressed Amar's offline comments.

        Show
        Vinay Kumar Thota added a comment - Addressed Amar's offline comments.
        Hide
        Amar Kamat added a comment -

        The latest patch looks good to me. +1.

        Show
        Amar Kamat added a comment - The latest patch looks good to me. +1.
        Hide
        Vinay Kumar Thota added a comment -

        Uploaded another new patch by incorporating some more comments.

        Show
        Vinay Kumar Thota added a comment - Uploaded another new patch by incorporating some more comments.
        Hide
        Amar Kamat added a comment -

        Looks good to me. +1.

        Show
        Amar Kamat added a comment - Looks good to me. +1.
        Hide
        Vinay Kumar Thota added a comment -

        Uploaded another new patch with a minor change.

        Show
        Vinay Kumar Thota added a comment - Uploaded another new patch with a minor change.
        Hide
        Vinay Kumar Thota added a comment -

        Ran the system tests against the patch and no issues found.
        Ran test-path manually and here is status.

        [exec] +1 overall.
        [exec]
        [exec] +1 @author. The patch does not contain any @author tags.
        [exec]
        [exec] +1 tests included. The patch appears to include 27 new or modified tests.
        [exec]
        [exec] +1 javadoc. The javadoc tool did not generate any warning messages.
        [exec]
        [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings.
        [exec]
        [exec] +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings.
        [exec]
        [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings.
        [exec]
        [exec] +1 system test framework. The patch passed system test framework compile.
        [exec]

        Show
        Vinay Kumar Thota added a comment - Ran the system tests against the patch and no issues found. Ran test-path manually and here is status. [exec] +1 overall. [exec] [exec] +1 @author. The patch does not contain any @author tags. [exec] [exec] +1 tests included. The patch appears to include 27 new or modified tests. [exec] [exec] +1 javadoc. The javadoc tool did not generate any warning messages. [exec] [exec] +1 javac. The applied patch does not increase the total number of javac compiler warnings. [exec] [exec] +1 findbugs. The patch does not introduce any new Findbugs (version 1.3.9) warnings. [exec] [exec] +1 release audit. The applied patch does not increase the total number of release audit warnings. [exec] [exec] +1 system test framework. The patch passed system test framework compile. [exec]
        Hide
        Amar Kamat added a comment -

        I just committed the latest patch to trunk. Thanks Vinay!

        Show
        Amar Kamat added a comment - I just committed the latest patch to trunk. Thanks Vinay!

          People

          • Assignee:
            Vinay Kumar Thota
            Reporter:
            Vinay Kumar Thota
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development