Uploaded image for project: 'Olio'
  1. Olio
  2. OLIO-34

Rails Driver does not check for accuracy in throughput to determine pass/fail

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • None
    • rails-driver
    • None
    • generic

    Description

      The driver only checks whether the various metrics reported in the summary report have passed the necessary criteria but does not check whether the resulting throughput (ops/sec) is correct for the scale of the run (number of concurrent users). Thus for example, it is possible to get 150 ops/sec for a run done with 1000 users and be reported as PASSED.

      This issue has been fixed in the PHP driver - fix needs to be ported to rails driver.

      Attachments

        Issue Links

          is a clone of

          Bug - A problem which impairs or prevents the functions of the product. OLIO-20 Driver does not check for accuracy in throughput to determine pass/fail

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Closed

          Activity

            People

              wsobel William Sobel
              shanti Shanti Subramanyam
              Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: