Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12277

NNThroughputBenchmark should use cumulativeTime to calculate ops per second.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Minor
    • Resolution: Not A Bug
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: benchmarks, tools
    • Labels:
      None

      Description

      NNThroughputBenchmark$getOpsPerSecond is using elapsedTime to calculate ops per second. elapsedTime is the time used to measure the time from the start to the finish of the benchmark main thread, and it's also the total execution time of the single slowest benchmark worker thread. To measure ops per second, we should use the total execution time of all worker threads, which is cumulativeTime. Otherwise, we could get bogus result, e.g. given same load, the more client threads we have (controlled by -threads), the larger ops per second the number would be, with the same NN and its server side configurations.

        Attachments

        1. HDFS-12277.000.patch
          0.8 kB
          Michael Han
        2. HDFS-12277.001.patch
          0.8 kB
          Michael Han

          Activity

            People

            • Assignee:
              hanm Michael Han
              Reporter:
              hanm Michael Han
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: