Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14456

Implement a namespace-based region grouping strategy for RegionGroupingProvider

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.0, 2.0.0
    • Fix Version/s: 1.3.0, 2.0.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In HBASE-5699 we introduced multiple wal, and after some succeeding works we now have two main kinds of wal providers: DefaultWALProvider and RegionGroupingProvider, while DefaultWALProvider supplies a single wal per regionserver, RegionGroupingProvider supplies multiple wals according to the RegionGroupingStrategy it's using.

      Now there're two kinds of RegionGroupingStrategy: identity and bounded, in which "identity" only for testing (trial) purpose and "bounded" for randomly assigning region writes to bounded number of wals. Although the "bounded" strategy is good enough for IO leverage, we may still want a more "designed" way to distribute the region writes, like having one wal group per business.

      Since we already have namespace for multi-tenancy, it would be good to have namespace-based grouping strategy, and this is exactly what this JIRA is for.

      There might be more benefits if we have namespace-based wal group, like only replicating data for the namespace in need w/o filtering anything useless, or only force region flush for the heavy loaded namespace, etc. although we won't include all these in this single JIRA.

        Attachments

        1. HBASE-14456.patch
          50 kB
          Yu Li
        2. HBASE-14456.branch-1.v2.patch
          49 kB
          Yu Li
        3. HBASE-14456.branch-1.patch
          49 kB
          Yu Li
        4. HBASE-14456_v3.patch
          50 kB
          Yu Li
        5. HBASE-14456_v2.patch
          50 kB
          Yu Li

          Issue Links

            Activity

              People

              • Assignee:
                liyu Yu Li
                Reporter:
                liyu Yu Li
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: