Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10475 Adding metrics for long FSNamesystem read and write locks
  3. HDFS-10872

Add MutableRate metrics for FSNamesystemLock operations

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 2.7.4, 3.0.0-alpha2
    • namenode
    • None
    • Reviewed

    Description

      Add metrics for FSNamesystemLock operations to see, overall, how long each operation is holding the lock for. Use MutableRate metrics for now.

      Attachments

        1. HDFS-10872.000.patch
          54 kB
          Erik Krogen
        2. FSLockPerf.java
          9 kB
          Erik Krogen
        3. HDFS-10872.001.patch
          90 kB
          Erik Krogen
        4. HDFS-10872.002.patch
          90 kB
          Erik Krogen
        5. HDFS-10872.003.patch
          90 kB
          Erik Krogen
        6. HDFS-10872.004.patch
          90 kB
          Erik Krogen
        7. HDFS-10872.005.patch
          85 kB
          Erik Krogen
        8. HDFS-10872.006.patch
          85 kB
          Erik Krogen
        9. HDFS-10872.007.patch
          84 kB
          Erik Krogen
        10. HDFS-10872.008.patch
          222 kB
          Erik Krogen
        11. HDFS-10872.009.patch
          84 kB
          Erik Krogen
        12. HDFS-10872.010.patch
          86 kB
          Erik Krogen
        13. jmx-output
          3 kB
          Erik Krogen
        14. HDFS-10872.011.patch
          86 kB
          Zhe Zhang
        15. HDFS-10872.012.patch
          85 kB
          Erik Krogen
        16. HDFS-10872-branch-2.012.patch
          80 kB
          Erik Krogen
        17. HDFS-10872-branch-2.013.patch
          80 kB
          Erik Krogen
        18. HDFS-10872-branch-2.7.013.patch
          78 kB
          Erik Krogen

        Issue Links

          depends upon

          Sub-task - The sub-task of the issue HDFS-10896 Move lock logging logic from FSNamesystem into FSNamesystemLock

          • Major - Major loss of function.
          • Resolved
          duplicates

          Sub-task - The sub-task of the issue HDFS-9952 Expose FSNamesystem lock wait time as metrics

          • Major - Major loss of function.
          • Resolved
          is depended upon by

          Sub-task - The sub-task of the issue HDFS-10873 Add histograms for FSNamesystemLock Metrics

          • Major - Major loss of function.
          • Open

          Sub-task - The sub-task of the issue HDFS-11021 Add FSNamesystemLock metrics for BlockManager operations

          • Major - Major loss of function.
          • Open
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-11261 Document missing NameNode metrics

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-13686 Add overall metrics for FSNamesystemLock

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HDFS-9952 Expose FSNamesystem lock wait time as metrics

          • Major - Major loss of function.
          • Resolved

          Bug - A problem which impairs or prevents the functions of the product. HDFS-13792 Fix FSN read/write lock metrics name

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Resolved
          requires

          Improvement - An improvement or enhancement to an existing feature or task. HADOOP-13782 Make MutableRates metrics thread-local write, aggregate-on-read

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              xkrogen Erik Krogen
              xkrogen Erik Krogen
              Votes:
              0 Vote for this issue
              Watchers:
              15 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: