Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2945

Allow NNThroughputBenchmark to stress IPC layer

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Won't Fix
    • Affects Version/s: 0.23.0
    • Fix Version/s: None
    • Component/s: benchmarks
    • Labels:
      None

      Description

      Currently, the NNThroughputBenchmark acts only as a benchmark of the NN itself. It accesses the NN directly rather than going via IPC. It would be nice to allow it to run in another mode where all access goes through the IPC layer, so that changes in IPC serialization performance can be repeatably/easily measured.

      1. hdfs-2945.txt
        15 kB
        Todd Lipcon

        Activity

        Hide
        tlipcon Todd Lipcon added a comment -

        I got this kinda sorta working, but it turned out to be a bit messier than I thought. I ended up writing HADOOP-8070 (a generic IPC benchmark) instead. Here's the half-done patch in case someone else wants to take this across the finish line

        Show
        tlipcon Todd Lipcon added a comment - I got this kinda sorta working, but it turned out to be a bit messier than I thought. I ended up writing HADOOP-8070 (a generic IPC benchmark) instead. Here's the half-done patch in case someone else wants to take this across the finish line

          People

          • Assignee:
            tlipcon Todd Lipcon
            Reporter:
            tlipcon Todd Lipcon
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development