Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15161 Umbrella: Miscellaneous improvements from production usage
  3. HBASE-15728

Add remaining per-table region / store / flush / compaction related metrics

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.0.0, 2.2.0, 2.3.0
    • Component/s: metrics
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      Hide
      Adds below flush, split, and compaction metrics

       + // split related metrics
       + private MutableFastCounter splitRequest;
       + private MutableFastCounter splitSuccess;
       + private MetricHistogram splitTimeHisto;
       +
       + // flush related metrics
       + private MetricHistogram flushTimeHisto;
       + private MetricHistogram flushMemstoreSizeHisto;
       + private MetricHistogram flushOutputSizeHisto;
       + private MutableFastCounter flushedMemstoreBytes;
       + private MutableFastCounter flushedOutputBytes;
       +
       + // compaction related metrics
       + private MetricHistogram compactionTimeHisto;
       + private MetricHistogram compactionInputFileCountHisto;
       + private MetricHistogram compactionInputSizeHisto;
       + private MetricHistogram compactionOutputFileCountHisto;
       + private MetricHistogram compactionOutputSizeHisto;
       + private MutableFastCounter compactedInputBytes;
       + private MutableFastCounter compactedOutputBytes;
       +
       + private MetricHistogram majorCompactionTimeHisto;
       + private MetricHistogram majorCompactionInputFileCountHisto;
       + private MetricHistogram majorCompactionInputSizeHisto;
       + private MetricHistogram majorCompactionOutputFileCountHisto;
       + private MetricHistogram majorCompactionOutputSizeHisto;
       + private MutableFastCounter majorCompactedInputBytes;
       + private MutableFastCounter majorCompactedOutputBytes;
      Show
      Adds below flush, split, and compaction metrics  + // split related metrics  + private MutableFastCounter splitRequest;  + private MutableFastCounter splitSuccess;  + private MetricHistogram splitTimeHisto;  +  + // flush related metrics  + private MetricHistogram flushTimeHisto;  + private MetricHistogram flushMemstoreSizeHisto;  + private MetricHistogram flushOutputSizeHisto;  + private MutableFastCounter flushedMemstoreBytes;  + private MutableFastCounter flushedOutputBytes;  +  + // compaction related metrics  + private MetricHistogram compactionTimeHisto;  + private MetricHistogram compactionInputFileCountHisto;  + private MetricHistogram compactionInputSizeHisto;  + private MetricHistogram compactionOutputFileCountHisto;  + private MetricHistogram compactionOutputSizeHisto;  + private MutableFastCounter compactedInputBytes;  + private MutableFastCounter compactedOutputBytes;  +  + private MetricHistogram majorCompactionTimeHisto;  + private MetricHistogram majorCompactionInputFileCountHisto;  + private MetricHistogram majorCompactionInputSizeHisto;  + private MetricHistogram majorCompactionOutputFileCountHisto;  + private MetricHistogram majorCompactionOutputSizeHisto;  + private MutableFastCounter majorCompactedInputBytes;  + private MutableFastCounter majorCompactedOutputBytes;

      Description

      Continuing on the work for per-table metrics, HBASE-15518 and HBASE-15671.

      We need to add some remaining metrics at the per-table level, so that we will have the same metrics reported at the per-regionserver, per-region and per-table levels.

      After this patch, most of the metrics at the RS and all of the per-region level are also reported at the per-table level.

        Attachments

        1. hbase-15728_v1.patch
          69 kB
          Enis Soztutar
        2. HBASE-15728.branch-1.001.patch
          71 kB
          Xu Cang
        3. HBASE-15728.branch-1.001.patch
          71 kB
          Xu Cang
        4. HBASE-15728.branch-1.002.patch
          76 kB
          Xu Cang
        5. HBASE-15728.branch-2.addendum.001.patch
          3 kB
          Guanghao Zhang
        6. HBASE-15728.branch-2.addendum.001.patch
          3 kB
          Xu Cang
        7. HBASE-15728.master.001.patch
          79 kB
          Xu Cang
        8. HBASE-15728.master.addendum.001.patch
          3 kB
          Guanghao Zhang
        9. HBASE-15728.master.addendum.001.patch
          3 kB
          Xu Cang

          Issue Links

            Activity

              People

              • Assignee:
                xucang Xu Cang
                Reporter:
                enis Enis Soztutar
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: