Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12277

NNThroughputBenchmark should use cumulativeTime to calculate ops per second.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Minor
    • Resolution: Not A Bug
    • None
    • None
    • benchmarks, tools
    • None

    Description

      NNThroughputBenchmark$getOpsPerSecond is using elapsedTime to calculate ops per second. elapsedTime is the time used to measure the time from the start to the finish of the benchmark main thread, and it's also the total execution time of the single slowest benchmark worker thread. To measure ops per second, we should use the total execution time of all worker threads, which is cumulativeTime. Otherwise, we could get bogus result, e.g. given same load, the more client threads we have (controlled by -threads), the larger ops per second the number would be, with the same NN and its server side configurations.

      Attachments

        1. HDFS-12277.001.patch
          0.8 kB
          Michael Han
        2. HDFS-12277.000.patch
          0.8 kB
          Michael Han

        Activity

          People

            hanm Michael Han
            hanm Michael Han
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: