Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-13199

Some small improvements on canary tool

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.0
    • 2.0.0
    • None
    • None

    Description

      Improvements

      • Make the sniff of region and regionserver parallel to support large cluster with 10000+ region and 500+ regionservers using thread pool.
      • Set cacheblock to false in get and scan to avoid influence to block cache.
      • Add FirstKeyOnlyFilter to get and scan to avoid read and translate too many data from HBase. There may be many column under a column family in a flat-wide table.
      • Select the region randomly when sniffing a regionserver.
      • Make the sink class of canary configurable

      stack

      Suggestions are welcomed. Thanks~

      Another question is that why to check each column family with separate requests when sniffing a region? Can we just check a column family of a region?

      Attachments

        1. HBASE-13199-addendum.diff
          1 kB
          Shaohui Liu
        2. HBASE-13199-addendum-v2.diff
          1 kB
          Shaohui Liu
        3. HBASE-13199-v1.diff
          22 kB
          Shaohui Liu
        4. HBASE-13199-v2.diff
          22 kB
          Shaohui Liu
        5. HBASE-13199-v3.diff
          22 kB
          Shaohui Liu
        6. HBASE-13199-v4.diff
          22 kB
          Shaohui Liu

        Activity

          People

            liushaohui Shaohui Liu
            liushaohui Shaohui Liu
            Votes:
            0 Vote for this issue
            Watchers:
            7 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: