Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-12345

Scale testing HDFS NameNode with real metadata and workloads (Dynamometer)

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.3.0
    • namenode, test
    • None

    Description

      Dynamometer has now been open sourced on our GitHub page. Read more at our recent blog post.

      To encourage getting the tool into the open for others to use as quickly as possible, we went through our standard open sourcing process of releasing on GitHub. However we are interested in the possibility of donating this to Apache as part of Hadoop itself and would appreciate feedback on whether or not this is something that would be supported by the community.

      Also of note, previous discussions on the dev mail lists

      Attachments

        1. HDFS-12345.009.patch
          447 kB
          Erik Krogen
        2. HDFS-12345.008.patch
          447 kB
          Erik Krogen
        3. HDFS-12345.007.patch
          442 kB
          Erik Krogen
        4. HDFS-12345.006.patch
          439 kB
          Erik Krogen
        5. HDFS-12345.005.patch
          437 kB
          Erik Krogen
        6. HDFS-12345.004.patch
          434 kB
          Yiqun Lin
        7. HDFS-12345.003.patch
          433 kB
          Yiqun Lin
        8. HDFS-12345.002.patch
          431 kB
          Siyao Meng
        9. HDFS-12345.001.patch
          430 kB
          Siyao Meng
        10. HDFS-12345.000.patch
          426 kB
          Erik Krogen

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-16411 Fix javadoc warnings in hadoop-dynamometer

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HADOOP-16418 Fix checkstyle and findbugs warnings in hadoop-dynamometer

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          is depended upon by

          Task - A task that needs to be done. HDFS-14281 Dynamometer Phase 2

          • Major - Major loss of function.
          • Open
          links to

          Web Link Dynamometer Gibhub Repo

          Web Link Dynamometer: Scale Testing HDFS on Minimal Hardware with Maximum Fidelity

          Activity

            People

              xkrogen Erik Krogen
              zhz Zhe Zhang
              Votes:
              0 Vote for this issue
              Watchers:
              42 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: