HBase
  1. HBase
  2. HBASE-11366

Backport HBASE-4089 (block cache contents report UI) to 0.98

    Details

    • Type: Task Task
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.98.4
    • Component/s: None
    • Labels:
      None

      Description

      Backport HBASE-4089 + HBASE-11329.

      Block caching is an active area of investigation and development. This is a nice facility that provides convenient introspection capabilities in UI.

        Activity

        Hide
        stack added a comment -

        You want me to make a patch for this Andrew?

        Show
        stack added a comment - You want me to make a patch for this Andrew?
        Hide
        Andrew Purtell added a comment -

        If you would not mind sir! Then we can pull it in right away. Otherwise I was thinking of picking this up for 0.98.5...

        Show
        Andrew Purtell added a comment - If you would not mind sir! Then we can pull it in right away. Otherwise I was thinking of picking this up for 0.98.5...
        Hide
        stack added a comment -

        Here. Doesn't have the TestBlockReporting... unit test but that is ok.... it does little by way of asserting (needs other backports). I tried it. Looks to do the right thing.

        Backporting because I found it useful observing what is going on in BC.

        Show
        stack added a comment - Here. Doesn't have the TestBlockReporting... unit test but that is ok.... it does little by way of asserting (needs other backports). I tried it. Looks to do the right thing. Backporting because I found it useful observing what is going on in BC.
        Hide
        Andrew Purtell added a comment -

        +1

        Show
        Andrew Purtell added a comment - +1
        Hide
        Andrew Purtell added a comment -

        Edited description, added rationale.

        Show
        Andrew Purtell added a comment - Edited description, added rationale.
        Hide
        stack added a comment -

        Pushed to 0.98 branch.

        Show
        stack added a comment - Pushed to 0.98 branch.
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in HBase-0.98 #345 (See https://builds.apache.org/job/HBase-0.98/345/)
        HBASE-11366 Backport HBASE-4089 (block cache contents report UI) to 0.98 (stack: rev da94cd398f9a0b1dc8d601a894314559e4f0939f)

        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheUtil.java
        • pom.xml
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCache.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFileBlockCacheSummary.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/RandomSeek.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CombinedBlockCache.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheKey.java
        • hbase-server/src/main/resources/hbase-webapps/master/snapshot.jsp
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CachedBlock.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHeapSize.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketAllocator.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/monitoring/StateDumpServlet.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheStats.java
        • hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheViewTmpl.jamon
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCacheStats.java
        • hbase-server/src/main/resources/hbase-webapps/master/zk.jsp
        • hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruCachedBlock.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/replication/ReplicationSourceDummy.java
        • hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
        • hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SlabCache.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/SimpleBlockCache.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestLruBlockCache.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSStatusServlet.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCachedBlockQueue.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CachedBlockQueue.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestBlockCacheColumnFamilySummary.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/FileIOEngine.java
        • hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockPriority.java
        • hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/RSStatusTmpl.jamon
        • hbase-server/src/main/resources/hbase-webapps/master/table.jsp
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SingleSizeCache.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCachesIterator.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCache.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruCachedBlockQueue.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/ByteBufferIOEngine.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheColumnFamilySummary.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/DoubleBlockCache.java
        • hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/ServerMetricsTmpl.jamon
        Show
        Hudson added a comment - SUCCESS: Integrated in HBase-0.98 #345 (See https://builds.apache.org/job/HBase-0.98/345/ ) HBASE-11366 Backport HBASE-4089 (block cache contents report UI) to 0.98 (stack: rev da94cd398f9a0b1dc8d601a894314559e4f0939f) hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheUtil.java pom.xml hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCache.java hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFileBlockCacheSummary.java hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/RandomSeek.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CombinedBlockCache.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheKey.java hbase-server/src/main/resources/hbase-webapps/master/snapshot.jsp hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CachedBlock.java hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHeapSize.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketAllocator.java hbase-server/src/main/java/org/apache/hadoop/hbase/monitoring/StateDumpServlet.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheStats.java hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheViewTmpl.jamon hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCacheStats.java hbase-server/src/main/resources/hbase-webapps/master/zk.jsp hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruCachedBlock.java hbase-server/src/test/java/org/apache/hadoop/hbase/replication/ReplicationSourceDummy.java hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SlabCache.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/SimpleBlockCache.java hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestLruBlockCache.java hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSStatusServlet.java hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCachedBlockQueue.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CachedBlockQueue.java hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestBlockCacheColumnFamilySummary.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/FileIOEngine.java hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockPriority.java hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/RSStatusTmpl.jamon hbase-server/src/main/resources/hbase-webapps/master/table.jsp hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SingleSizeCache.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCachesIterator.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCache.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruCachedBlockQueue.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/ByteBufferIOEngine.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheColumnFamilySummary.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/DoubleBlockCache.java hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/ServerMetricsTmpl.jamon
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in HBase-0.98-on-Hadoop-1.1 #326 (See https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/326/)
        HBASE-11366 Backport HBASE-4089 (block cache contents report UI) to 0.98 (stack: rev da94cd398f9a0b1dc8d601a894314559e4f0939f)

        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CachedBlock.java
        • hbase-server/src/main/resources/hbase-webapps/master/table.jsp
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/ByteBufferIOEngine.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCache.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruCachedBlockQueue.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheKey.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCacheStats.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/RandomSeek.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/FileIOEngine.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/replication/ReplicationSourceDummy.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockPriority.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/DoubleBlockCache.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHeapSize.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSStatusServlet.java
        • hbase-server/src/main/resources/hbase-webapps/master/snapshot.jsp
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/SimpleBlockCache.java
        • hbase-server/src/main/resources/hbase-webapps/master/zk.jsp
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheColumnFamilySummary.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheStats.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketAllocator.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SingleSizeCache.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheUtil.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestBlockCacheColumnFamilySummary.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CombinedBlockCache.java
        • hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCachedBlockQueue.java
        • hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheViewTmpl.jamon
        • hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SlabCache.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruCachedBlock.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CachedBlockQueue.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCachesIterator.java
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCache.java
        • hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/ServerMetricsTmpl.jamon
        • hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestLruBlockCache.java
        • hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp
        • hbase-server/src/main/java/org/apache/hadoop/hbase/monitoring/StateDumpServlet.java
        • hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon
        • hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java
        • hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/RSStatusTmpl.jamon
        • hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon
        • pom.xml
        • hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFileBlockCacheSummary.java
        Show
        Hudson added a comment - SUCCESS: Integrated in HBase-0.98-on-Hadoop-1.1 #326 (See https://builds.apache.org/job/HBase-0.98-on-Hadoop-1.1/326/ ) HBASE-11366 Backport HBASE-4089 (block cache contents report UI) to 0.98 (stack: rev da94cd398f9a0b1dc8d601a894314559e4f0939f) hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CachedBlock.java hbase-server/src/main/resources/hbase-webapps/master/table.jsp hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/ByteBufferIOEngine.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCache.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruCachedBlockQueue.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheKey.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketCacheStats.java hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/RandomSeek.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/FileIOEngine.java hbase-server/src/test/java/org/apache/hadoop/hbase/replication/ReplicationSourceDummy.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockPriority.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/DoubleBlockCache.java hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHeapSize.java hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSStatusServlet.java hbase-server/src/main/resources/hbase-webapps/master/snapshot.jsp hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/SimpleBlockCache.java hbase-server/src/main/resources/hbase-webapps/master/zk.jsp hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheColumnFamilySummary.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheStats.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/bucket/BucketAllocator.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SingleSizeCache.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCacheUtil.java hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestBlockCacheColumnFamilySummary.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CombinedBlockCache.java hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCachedBlockQueue.java hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheViewTmpl.jamon hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/slab/SlabCache.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruCachedBlock.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CachedBlockQueue.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCachesIterator.java hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/BlockCache.java hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/ServerMetricsTmpl.jamon hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestLruBlockCache.java hbase-server/src/main/resources/hbase-webapps/master/tablesDetailed.jsp hbase-server/src/main/java/org/apache/hadoop/hbase/monitoring/StateDumpServlet.java hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/master/MasterStatusTmpl.jamon hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/LruBlockCache.java hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/RSStatusTmpl.jamon hbase-server/src/main/jamon/org/apache/hadoop/hbase/tmpl/regionserver/BlockCacheTmpl.jamon pom.xml hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestStoreFileBlockCacheSummary.java

          People

          • Assignee:
            stack
            Reporter:
            Andrew Purtell
          • Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development