Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-1804

Stress-test tool for HDFS introduced in HDFS-708

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.0
    • Component/s: benchmarks, test
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      This issue is to commit the SLive test developed in HDFS-708 to MR trunk.

      1. slive.patch.2
        216 kB
        Konstantin Shvachko

        Issue Links

          Activity

          Transition Time In Source Status Execution Times Last Executer Last Execution Date
          Open Open Patch Available Patch Available
          19m 46s 1 Konstantin Shvachko 20/May/10 19:25
          Patch Available Patch Available Resolved Resolved
          5h 45m 1 Konstantin Shvachko 21/May/10 01:11
          Resolved Resolved Closed Closed
          570d 5h 7m 1 Konstantin Shvachko 12/Dec/11 06:18
          Konstantin Shvachko made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Hide
          Hudson added a comment -

          Integrated in Hadoop-Mapreduce-trunk #324 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/324/)
          Moving MAPREDUCE-1804 to new features.
          MAPREDUCE-1804. Stress-test tool for HDFS introduced in HDFS-708. Contributed by Joshua Harlow.

          Show
          Hudson added a comment - Integrated in Hadoop-Mapreduce-trunk #324 (See http://hudson.zones.apache.org/hudson/job/Hadoop-Mapreduce-trunk/324/ ) Moving MAPREDUCE-1804 to new features. MAPREDUCE-1804 . Stress-test tool for HDFS introduced in HDFS-708 . Contributed by Joshua Harlow.
          Konstantin Shvachko made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Hide
          Konstantin Shvachko added a comment -

          I just committed this. Thank you Joshua.

          Show
          Konstantin Shvachko added a comment - I just committed this. Thank you Joshua.
          Hide
          Hadoop QA added a comment -

          -1 overall. Here are the results of testing the latest attachment
          http://issues.apache.org/jira/secure/attachment/12445095/slive.patch.2
          against trunk revision 946578.

          +1 @author. The patch does not contain any @author tags.

          +1 tests included. The patch appears to include 112 new or modified tests.

          +1 javadoc. The javadoc tool did not generate any warning messages.

          +1 javac. The applied patch does not increase the total number of javac compiler warnings.

          +1 findbugs. The patch does not introduce any new Findbugs warnings.

          +1 release audit. The applied patch does not increase the total number of release audit warnings.

          +1 core tests. The patch passed core unit tests.

          -1 contrib tests. The patch failed contrib unit tests.

          Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/196/testReport/
          Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/196/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html
          Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/196/artifact/trunk/build/test/checkstyle-errors.html
          Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/196/console

          This message is automatically generated.

          Show
          Hadoop QA added a comment - -1 overall. Here are the results of testing the latest attachment http://issues.apache.org/jira/secure/attachment/12445095/slive.patch.2 against trunk revision 946578. +1 @author. The patch does not contain any @author tags. +1 tests included. The patch appears to include 112 new or modified tests. +1 javadoc. The javadoc tool did not generate any warning messages. +1 javac. The applied patch does not increase the total number of javac compiler warnings. +1 findbugs. The patch does not introduce any new Findbugs warnings. +1 release audit. The applied patch does not increase the total number of release audit warnings. +1 core tests. The patch passed core unit tests. -1 contrib tests. The patch failed contrib unit tests. Test results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/196/testReport/ Findbugs warnings: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/196/artifact/trunk/build/test/findbugs/newPatchFindbugsWarnings.html Checkstyle results: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/196/artifact/trunk/build/test/checkstyle-errors.html Console output: http://hudson.zones.apache.org/hudson/job/Mapreduce-Patch-h4.grid.sp2.yahoo.net/196/console This message is automatically generated.
          Konstantin Shvachko made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Konstantin Shvachko made changes -
          Attachment slive.patch.2 [ 12445095 ]
          Hide
          Konstantin Shvachko added a comment -

          Attaching patch from HDFS-708 to let Hudson run it with MR.
          I realized running it with HDFS Hudson was not useful, since the patch does not change hdfs.
          This patch is the exact copy of Joshua's patch, except for a couple of cosmetic changes and removal of public from two methods.

          Show
          Konstantin Shvachko added a comment - Attaching patch from HDFS-708 to let Hudson run it with MR. I realized running it with HDFS Hudson was not useful, since the patch does not change hdfs. This patch is the exact copy of Joshua's patch, except for a couple of cosmetic changes and removal of public from two methods.
          Konstantin Shvachko made changes -
          Field Original Value New Value
          Link This issue incorporates HDFS-708 [ HDFS-708 ]
          Konstantin Shvachko created issue -

            People

            • Assignee:
              Konstantin Shvachko
              Reporter:
              Konstantin Shvachko
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development