Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15161

Umbrella: Miscellaneous improvements from production usage

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1, 2.3.0
    • None
    • None
    • This ticket summarizes significant improvements and expansion to the metrics surface area. Interested users should review the individual sub-tasks.

    Description

      We use HBase to (mainly) build index for our search engine in Alibaba. Recently we are upgrading our online cluster from 0.98.12 to 1.x and I'd like to take the opportunity to contribute a bunch of our private patches to community (better late than never, I hope ). This is an umbrella to track this effort.

      Attachments

        Issue Links

        contains

        Sub-task - The sub-task of the issue HBASE-14061 Support CF-level Storage Policy

        • Major - Major loss of function.
        • Closed

        Sub-task - The sub-task of the issue HBASE-15172 Support setting storage policy in bulkload

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HBASE-16393 Improve computeHDFSBlocksDistribution

        • Major - Major loss of function.
        • Closed
        is related to

        Improvement - An improvement or enhancement to an existing feature or task. HBASE-15614 Report metrics from JvmPauseMonitor

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HBASE-15643 Need metrics of cache hit ratio, etc for one table

        • Major - Major loss of function.
        • Closed
        relates to

        Bug - A problem which impairs or prevents the functions of the product. HBASE-15595 Document new metrics improvements

        • Major - Major loss of function.
        • Closed

        Improvement - An improvement or enhancement to an existing feature or task. HBASE-14983 Create metrics for per block type hit/miss ratios

        • Major - Major loss of function.
        • Closed
        1.
        		 Put back HFile's HDFS op latency sampling code and add metrics for monitoring Sub-task Closed Yu Li Actions
        2.
        		 Add separate metrics for meta/data block hit ratio in cache Sub-task Closed Unassigned Actions
        3.
        		 Add sampling code and metrics for get/scan/multi/mutate count separately Sub-task Closed Yu Li Actions
        4.
        		 Avoid counting duplicate kv and generating lots of small hfiles in PutSortReducer Sub-task Closed Yu Li Actions
        5.
        		 ScanNext metric is size-based while every other per-operation metric is time based Sub-task Closed Heng Chen Actions
        6.
        		 Per-RS Get metric is time based, per-region metric is size-based Sub-task Closed Heng Chen Actions
        7.
        		 Add average region size metric Sub-task Closed Alicia Ying Shu Actions
        8.
        		 Add WAL (in bytes) written metric Sub-task Closed Alicia Ying Shu Actions
        9.
        		 Flush / Compaction metrics revisited Sub-task Closed Enis Soztutar Actions
        10.
        		 Add Per-Table metrics back Sub-task Closed Alicia Ying Shu Actions
        11.
        		 Add per-user metrics Sub-task Closed Ankit Singhal Actions
        12.
        		 Add per-table metrics on memstore, storefile and regionsize Sub-task Closed Alicia Ying Shu Actions
        13.
        		 Add more details about region on table.jsp Sub-task Closed Yu Li Actions
        14.
        		 Min latency in latency histograms are emitted as Long.MAX_VALUE Sub-task Closed Enis Soztutar Actions
        15.
        		 Add remaining per-table region / store / flush / compaction related metrics Sub-task Closed Xu Cang Actions
        16.
        		 Replication source.shippedKBs metric is undercounting because it is in KB Sub-task Closed Enis Soztutar Actions
        17.
        		 CLONE - Add Per-Table metrics back Sub-task Closed Alicia Ying Shu Actions

        Activity
          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            liyu Yu Li
            liyu Yu Li
            Votes:
            0 Vote for this issue
            Watchers:
            15 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment