Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15161 Umbrella: Miscellaneous improvements from production usage
  3. HBASE-15160

Put back HFile's HDFS op latency sampling code and add metrics for monitoring

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 1.1.2, 2.0.0
    • 1.4.0, 2.0.0
    • None
    • None
    • Reviewed

    Description

      In HBASE-11586 all HDFS op latency sampling code, including fsReadLatency, fsPreadLatency and fsWriteLatency, have been removed. There was some discussion about putting them back in a new JIRA but never happened. According to our experience, these metrics are useful to judge whether issue lies on HDFS when slow request occurs, so we propose to put them back in this JIRA, and add the metrics for monitoring as well.

      Attachments

        1. HBASE-15160_v2.patch
          16 kB
          Yu Li
        2. HBASE-15160_v3.patch
          20 kB
          Yu Li
        3. hbase-15160_v4.patch
          33 kB
          Enis Soztutar
        4. hbase-15160_v5.patch
          33 kB
          Enis Soztutar
        5. hbase-15160_v6.patch
          41 kB
          Enis Soztutar
        6. hbase-15160_v7.patch
          41 kB
          Yu Li
        7. hbase-15160_v8.branch-1.patch
          39 kB
          Enis Soztutar
        8. hbase-15160_v8.branch-1.patch
          39 kB
          Enis Soztutar
        9. hbase-15160_v8.branch-1.patch
          39 kB
          Enis Soztutar
        10. hbase-15160_v8.patch
          41 kB
          Enis Soztutar
        11. HBASE-15160.patch
          16 kB
          Yu Li

        Issue Links

          is depended upon by

          Sub-task - The sub-task of the issue HBASE-15162 Add separate metrics for meta/data block hit ratio in cache

          • Major - Major loss of function.
          • Closed
          is related to

          Bug - A problem which impairs or prevents the functions of the product. HBASE-18184 Add hbase-hadoop2-compat jar as MapReduce job dependency

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-27888 Record readBlock message in log when it takes too long time

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved
          links to

          Web Link ReviewBoard Link

          Activity

            People

              liyu Yu Li
              liyu Yu Li
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: