Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14456

Implement a namespace-based region grouping strategy for RegionGroupingProvider

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.3.0, 2.0.0
    • 1.3.0, 2.0.0
    • None
    • None
    • Reviewed

    Description

      In HBASE-5699 we introduced multiple wal, and after some succeeding works we now have two main kinds of wal providers: DefaultWALProvider and RegionGroupingProvider, while DefaultWALProvider supplies a single wal per regionserver, RegionGroupingProvider supplies multiple wals according to the RegionGroupingStrategy it's using.

      Now there're two kinds of RegionGroupingStrategy: identity and bounded, in which "identity" only for testing (trial) purpose and "bounded" for randomly assigning region writes to bounded number of wals. Although the "bounded" strategy is good enough for IO leverage, we may still want a more "designed" way to distribute the region writes, like having one wal group per business.

      Since we already have namespace for multi-tenancy, it would be good to have namespace-based grouping strategy, and this is exactly what this JIRA is for.

      There might be more benefits if we have namespace-based wal group, like only replicating data for the namespace in need w/o filtering anything useless, or only force region flush for the heavy loaded namespace, etc. although we won't include all these in this single JIRA.

      Attachments

        1. HBASE-14456.patch
          50 kB
          Yu Li
        2. HBASE-14456_v2.patch
          50 kB
          Yu Li
        3. HBASE-14456_v3.patch
          50 kB
          Yu Li
        4. HBASE-14456.branch-1.patch
          49 kB
          Yu Li
        5. HBASE-14456.branch-1.v2.patch
          49 kB
          Yu Li

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            liyu Yu Li
            liyu Yu Li
            Votes:
            0 Vote for this issue
            Watchers:
            8 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment