Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-14457

Umbrella: Improve Multiple WAL for production usage

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Umbrella
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.3.0, 2.0.0
    • Component/s: None
    • Labels:
      None

      Description

      HBASE-5699 proposed the idea to run with multiple WAL in regionserver and did a great initial work there, but when trying to use it in our production cluster, we still found several issues to resolve, like tracking multiple WAL paths in replication (HBASE-6617), fixing UT with multiwal provider (HBASE-14411), introducing a namespace-based strategy for RegionGroupingProvider (HBASE-14456), etc. This is an umbrella including(but not limited of) all these works and efforts to make multiple wal ready for production usage and give user a clear picture about it.

      Besides the developing works done, I'd also like to share some scenarios and testing/online data in this JIRA about our usage/performance of multiple wal, to(hopefully) help people better judge whether to enable multiple wal or not in their own cluster and what they might gain.

        Attachments

        1. Action in Multiple WAL.pdf
          5.31 MB
          Yu Li
        2. Action in Multiple WAL.pdf
          5.32 MB
          Yu Li

        Issue Links

          Activity

            People

            • Assignee:
              liyu Yu Li
              Reporter:
              liyu Yu Li

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment