Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-20610

Procedure V2 - Distributed Log Splitting

VotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Umbrella
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 3.0.0-alpha-1, 2.2.0
    • proc-v2
    • None
    • Reviewed
    • See RN in HBASE-21588 for detail on this feature. It landed in hbase-2.2.0.

    Description

      Now master and regionserver use zk to coordinate log split tasks. The split log manager manages all log files which need to be scanned and split. Then the split log manager places all the logs into the ZooKeeper splitWAL node (/hbase/splitWAL) as tasks and monitors these task nodes and waits for them to be processed. Each regionserver watch splitWAL znode and grab task when node children changed. And regionserver does the work to split the logs.

      Open this umbrella issue to move this "coordinate" work to use new procedure v2 framework and reduce zk depencency. Plan to finish this before 3.0 release. Any suggestions are welcomed. Thanks.

      Attachments

        1. HBASE-20610.master.001.patch
          47 kB
          Jingyun Tian
        There are no Sub-Tasks for this issue.

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            tianjingyun Jingyun Tian
            zghao Guanghao Zhang
            Votes:
            0 Vote for this issue
            Watchers:
            14 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Issue deployment