Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14743

Add metrics around HeapMemoryManager

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • None
    • 2.0.0
    • None
    • None
    • Hide
      A memory metrics reveals situations happened in both MemStores and BlockCache in RegionServer. Through this metrics, users/operators can know
      1). Current size of MemStores and BlockCache in bytes.
      2). Occurrence for Memstore minor and major flush. (named unblocked flush and blocked flush respectively, shown in histogram)
      3). Dynamic changes in size between MemStores and BlockCache. (with Increase/Decrease as prefix, shown in histogram). And a counter for no changes, named DoNothingCounter.
      4). Occurrence for memory usage alarm (used more than 95% by default) in RegionServer. (named AboveHeapOccupancyLowWatermarkCounter)
      Show
      A memory metrics reveals situations happened in both MemStores and BlockCache in RegionServer. Through this metrics, users/operators can know 1). Current size of MemStores and BlockCache in bytes. 2). Occurrence for Memstore minor and major flush. (named unblocked flush and blocked flush respectively, shown in histogram) 3). Dynamic changes in size between MemStores and BlockCache. (with Increase/Decrease as prefix, shown in histogram). And a counter for no changes, named DoNothingCounter. 4). Occurrence for memory usage alarm (used more than 95% by default) in RegionServer. (named AboveHeapOccupancyLowWatermarkCounter)

    Description

      it would be good to know how many invocations there have been.
      How many decided to expand memstore.
      How many decided to expand block cache.
      How many decided to do nothing.
      etc.

      When that's done use those metrics to clean up the tests.

      Attachments

        1. test2_4.png
          360 kB
          Apekshit Sharma
        2. test2_3.png
          342 kB
          Apekshit Sharma
        3. test2_2.png
          345 kB
          Apekshit Sharma
        4. test2_1.png
          367 kB
          Apekshit Sharma
        5. Screen Shot 2016-06-16 at 5.39.13 PM.png
          370 kB
          Michael Stack
        6. Metrics snapshot 2016-6-30.png
          55 kB
          Reid Chan
        7. HBASE-14743.011.patch
          27 kB
          Reid Chan
        8. HBASE-14743.010.v2.patch
          26 kB
          Reid Chan
        9. HBASE-14743.010.patch
          26 kB
          Reid Chan
        10. HBASE-14743.009.v2.patch
          26 kB
          Reid Chan
        11. HBASE-14743.009.rw3.patch
          26 kB
          Reid Chan
        12. HBASE-14743.009.patch
          26 kB
          Reid Chan

        Issue Links

          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HBASE-16401 Enable HeapMemoryManager by default in 2.0

          • Critical - Crashes, loss of data, severe memory leak.
          • Open

          Activity

            People

              reidchan Reid Chan
              eclark Elliott Neil Clark
              Votes:
              0 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: