Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.22.0
    • Fix Version/s: 0.22.0
    • Component/s: test, tools
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Does not currently provide anything but uniform distribution.
      Uses some older depreciated class interfaces (for mapper and reducer)
      This was tested on 0.20 and 0.22 (locally) so it should be fairly backwards compatible.
      Show
      Does not currently provide anything but uniform distribution. Uses some older depreciated class interfaces (for mapper and reducer) This was tested on 0.20 and 0.22 (locally) so it should be fairly backwards compatible.

      Description

      It would be good to have a tool for automatic stress testing HDFS, which would provide IO-intensive load on HDFS cluster.
      The idea is to start the tool, let it run overnight, and then be able to analyze possible failures.

      1. slive.patch
        229 kB
        Joshua Harlow
      2. slive.patch.1
        216 kB
        Joshua Harlow
      3. SLiveTest.pdf
        41 kB
        Konstantin Shvachko
      4. SLiveTest.pdf
        41 kB
        Konstantin Shvachko
      5. SLiveTest.pdf
        42 kB
        Konstantin Shvachko

        Issue Links

          Activity

          Konstantin Shvachko created issue -
          Konstantin Boudnik made changes -
          Field Original Value New Value
          Link This issue relates to HADOOP-6332 [ HADOOP-6332 ]
          Konstantin Shvachko made changes -
          Assignee Konstantin Shvachko [ shv ]
          Konstantin Shvachko made changes -
          Attachment SLiveTest.pdf [ 12436414 ]
          Konstantin Shvachko made changes -
          Assignee Konstantin Shvachko [ shv ]
          Hairong Kuang made changes -
          Link This issue is duplicated by HDFS-522 [ HDFS-522 ]
          Hairong Kuang made changes -
          Link This issue relates to HDFS-523 [ HDFS-523 ]
          Konstantin Shvachko made changes -
          Link This issue relates to HADOOP-193 [ HADOOP-193 ]
          Joshua Harlow made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Release Note Does not currently provide anything but uniform distribution.
          Uses some older depreciated class interfaces (for mapper and reducer)
          This was tested on 0.20 and 0.22 (locally) so it should be fairly backwards compatible.
          Joshua Harlow made changes -
          Attachment slive.patch [ 12442927 ]
          Jakob Homan made changes -
          Assignee Joshua Harlow [ harlowja ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443101 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12442927 ]
          Jakob Homan made changes -
          Status Patch Available [ 10002 ] Open [ 1 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443231 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443101 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443319 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443231 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443357 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443319 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443497 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443357 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443536 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443497 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443749 ]
          Joshua Harlow made changes -
          Attachment slive.patch [ 12443536 ]
          Joshua Harlow made changes -
          Attachment slive.patch.1 [ 12444885 ]
          Konstantin Shvachko made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Konstantin Shvachko made changes -
          Link This issue is part of MAPREDUCE-1804 [ MAPREDUCE-1804 ]
          Konstantin Shvachko made changes -
          Attachment SLiveTest.pdf [ 12445127 ]
          Konstantin Shvachko made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Hadoop Flags [Reviewed]
          Resolution Fixed [ 1 ]
          Konstantin Shvachko made changes -
          Attachment SLiveTest.pdf [ 12448004 ]
          Konstantin Shvachko made changes -
          Link This issue relates to MAPREDUCE-1893 [ MAPREDUCE-1893 ]
          Konstantin Shvachko made changes -
          Status Resolved [ 5 ] Closed [ 6 ]
          Jeff Hammerbacher made changes -
          Link This issue relates to HDFS-2984 [ HDFS-2984 ]

            People

            • Assignee:
              Joshua Harlow
              Reporter:
              Konstantin Shvachko
            • Votes:
              0 Vote for this issue
              Watchers:
              22 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development