Index: src/docbkx/book.xml =================================================================== --- src/docbkx/book.xml (revision 1182615) +++ src/docbkx/book.xml (working copy) @@ -607,70 +607,7 @@ - - Metrics -
- Metric Setup - See Metrics for - an introduction and how to enable Metrics emission. - -
-
- RegionServer Metrics -
<varname>hbase.regionserver.blockCacheCount</varname> - Block cache item count in memory. This is the number of blocks of storefiles (HFiles) in the cache. -
-
<varname>hbase.regionserver.blockCacheFree</varname> - Block cache memory available (bytes). -
-
<varname>hbase.regionserver.blockCacheHitRatio</varname> - Block cache hit ratio (0 to 100). TODO: describe impact to ratio where read requests that have cacheBlocks=false -
-
<varname>hbase.regionserver.blockCacheSize</varname> - Block cache size in memory (bytes). i.e., memory in use by the BlockCache -
-
<varname>hbase.regionserver.compactionQueueSize</varname> - Size of the compaction queue. This is the number of stores in the region that have been targeted for compaction. -
-
<varname>hbase.regionserver.fsReadLatency_avg_time</varname> - Filesystem read latency (ms). This is the average time to read from HDFS. -
-
<varname>hbase.regionserver.fsReadLatency_num_ops</varname> - TODO -
-
<varname>hbase.regionserver.fsSyncLatency_avg_time</varname> - Filesystem sync latency (ms) -
-
<varname>hbase.regionserver.fsSyncLatency_num_ops</varname> - TODO -
-
<varname>hbase.regionserver.fsWriteLatency_avg_time</varname> - Filesystem write latency (ms) -
-
<varname>hbase.regionserver.fsWriteLatency_num_ops</varname> - TODO -
-
<varname>hbase.regionserver.memstoreSizeMB</varname> - Sum of all the memstore sizes in this RegionServer (MB) -
-
<varname>hbase.regionserver.regions</varname> - Number of regions served by the RegionServer -
-
<varname>hbase.regionserver.requests</varname> - Total number of read and write requests. Requests correspond to RegionServer RPC calls, thus a single Get will result in 1 request, but a Scan with caching set to 1000 will result in 1 request for each 'next' call (i.e., not each row). A bulk-load request will constitute 1 request per HFile. -
-
<varname>hbase.regionserver.storeFileIndexSizeMB</varname> - Sum of all the storefile index sizes in this RegionServer (MB) -
-
<varname>hbase.regionserver.stores</varname> - Number of stores open on the RegionServer. A store corresponds to a column family. For example, if a table (which contains the column family) has 3 regions on a RegionServer, there will be 3 stores open for that column family. -
-
<varname>hbase.regionserver.storeFiles</varname> - Number of store filles open on the RegionServer. A store may have more than one storefile (HFile). -
-
-
- + Data Model In short, applications store data into an HBase table. @@ -1782,7 +1719,6 @@ - Index: src/docbkx/developer.xml =================================================================== --- src/docbkx/developer.xml (revision 1182615) +++ src/docbkx/developer.xml (working copy) @@ -7,8 +7,9 @@ xmlns:m="http://www.w3.org/1998/Math/MathML" xmlns:html="http://www.w3.org/1999/xhtml" xmlns:db="http://docbook.org/ns/docbook"> - Developing HBase - This chapter will be of interest only to those developing HBase (i.e., as opposed to using it). + Building and Developing HBase + This chapter will be of interest only to those building and developing HBase (i.e., as opposed to + just downloading the latest distribution).
HBase Repositories @@ -24,7 +25,8 @@ git clone git://git.apache.org/hbase.git
- + +
IDEs
@@ -96,6 +98,51 @@
+ +
+ Building HBase + This section will be of interest only to those building HBase from source. + +
+ Building in snappy compression support + Pass -Dsnappy to trigger the snappy maven profile for building + snappy native libs into hbase. +
+ +
+ Adding an HBase release to Apache's Maven Repository + Follow the instructions at + Publishing Maven Artifacts. + The 'trick' to making it all work is answering the questions put to you by the mvn release plugin properly, + making sure it is using the actual branch AND before doing the mvn release:perform step, + VERY IMPORTANT, hand edit the release.properties file that was put under ${HBASE_HOME} + by the previous step, release:perform. You need to edit it to make it point at + right locations in SVN. + + If you see run into the below, its because you need to edit version in the pom.xml and add + -SNAPSHOT to the version (and commit). + [INFO] Scanning for projects... +[INFO] Searching repository for plugin with prefix: 'release'. +[INFO] ------------------------------------------------------------------------ +[INFO] Building HBase +[INFO] task-segment: [release:prepare] (aggregator-style) +[INFO] ------------------------------------------------------------------------ +[INFO] [release:prepare {execution: default-cli}] +[INFO] ------------------------------------------------------------------------ +[ERROR] BUILD FAILURE +[INFO] ------------------------------------------------------------------------ +[INFO] You don't have a SNAPSHOT project in the reactor projects list. +[INFO] ------------------------------------------------------------------------ +[INFO] For more information, run Maven with the -e switch +[INFO] ------------------------------------------------------------------------ +[INFO] Total time: 3 seconds +[INFO] Finished at: Sat Mar 26 18:11:07 PDT 2011 +[INFO] Final Memory: 35M/423M +[INFO] ----------------------------------------------------------------------- + +
+
+
Maven Build Commands All commands executed from the local HBase project directory. Index: src/docbkx/ops_mgt.xml =================================================================== --- src/docbkx/ops_mgt.xml (revision 1182615) +++ src/docbkx/ops_mgt.xml (working copy) @@ -246,6 +246,70 @@
+
+ Metrics +
+ Metric Setup + See Metrics for + an introduction and how to enable Metrics emission. + +
+
+ RegionServer Metrics +
<varname>hbase.regionserver.blockCacheCount</varname> + Block cache item count in memory. This is the number of blocks of storefiles (HFiles) in the cache. +
+
<varname>hbase.regionserver.blockCacheFree</varname> + Block cache memory available (bytes). +
+
<varname>hbase.regionserver.blockCacheHitRatio</varname> + Block cache hit ratio (0 to 100). TODO: describe impact to ratio where read requests that have cacheBlocks=false +
+
<varname>hbase.regionserver.blockCacheSize</varname> + Block cache size in memory (bytes). i.e., memory in use by the BlockCache +
+
<varname>hbase.regionserver.compactionQueueSize</varname> + Size of the compaction queue. This is the number of stores in the region that have been targeted for compaction. +
+
<varname>hbase.regionserver.fsReadLatency_avg_time</varname> + Filesystem read latency (ms). This is the average time to read from HDFS. +
+
<varname>hbase.regionserver.fsReadLatency_num_ops</varname> + TODO +
+
<varname>hbase.regionserver.fsSyncLatency_avg_time</varname> + Filesystem sync latency (ms) +
+
<varname>hbase.regionserver.fsSyncLatency_num_ops</varname> + TODO +
+
<varname>hbase.regionserver.fsWriteLatency_avg_time</varname> + Filesystem write latency (ms) +
+
<varname>hbase.regionserver.fsWriteLatency_num_ops</varname> + TODO +
+
<varname>hbase.regionserver.memstoreSizeMB</varname> + Sum of all the memstore sizes in this RegionServer (MB) +
+
<varname>hbase.regionserver.regions</varname> + Number of regions served by the RegionServer +
+
<varname>hbase.regionserver.requests</varname> + Total number of read and write requests. Requests correspond to RegionServer RPC calls, thus a single Get will result in 1 request, but a Scan with caching set to 1000 will result in 1 request for each 'next' call (i.e., not each row). A bulk-load request will constitute 1 request per HFile. +
+
<varname>hbase.regionserver.storeFileIndexSizeMB</varname> + Sum of all the storefile index sizes in this RegionServer (MB) +
+
<varname>hbase.regionserver.stores</varname> + Number of stores open on the RegionServer. A store corresponds to a column family. For example, if a table (which contains the column family) has 3 regions on a RegionServer, there will be 3 stores open for that column family. +
+
<varname>hbase.regionserver.storeFiles</varname> + Number of store filles open on the RegionServer. A store may have more than one storefile (HFile). +
+
+
+
HBase Monitoring TODO Index: src/docbkx/build.xml =================================================================== --- src/docbkx/build.xml (revision 1182615) +++ src/docbkx/build.xml (working copy) @@ -1,52 +0,0 @@ - - - Building HBase - This chapter will be of interest only to those building HBase from source. - -
- Building in snappy compression support - Pass -Dsnappy to trigger the snappy maven profile for building - snappy native libs into hbase. -
- -
- Adding an HBase release to Apache's Maven Repository - Follow the instructions at - Publishing Maven Artifacts. - The 'trick' to making it all work is answering the questions put to you by the mvn release plugin properly, - making sure it is using the actual branch AND before doing the mvn release:perform step, - VERY IMPORTANT, hand edit the release.properties file that was put under ${HBASE_HOME} - by the previous step, release:perform. You need to edit it to make it point at - right locations in SVN. - - If you see run into the below, its because you need to edit version in the pom.xml and add - -SNAPSHOT to the version (and commit). - [INFO] Scanning for projects... -[INFO] Searching repository for plugin with prefix: 'release'. -[INFO] ------------------------------------------------------------------------ -[INFO] Building HBase -[INFO] task-segment: [release:prepare] (aggregator-style) -[INFO] ------------------------------------------------------------------------ -[INFO] [release:prepare {execution: default-cli}] -[INFO] ------------------------------------------------------------------------ -[ERROR] BUILD FAILURE -[INFO] ------------------------------------------------------------------------ -[INFO] You don't have a SNAPSHOT project in the reactor projects list. -[INFO] ------------------------------------------------------------------------ -[INFO] For more information, run Maven with the -e switch -[INFO] ------------------------------------------------------------------------ -[INFO] Total time: 3 seconds -[INFO] Finished at: Sat Mar 26 18:11:07 PDT 2011 -[INFO] Final Memory: 35M/423M -[INFO] ----------------------------------------------------------------------- - -
- -