Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-9888

HBase replicates edits written before the replication peer is created

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Patch Available
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.5.0
    • Fix Version/s: 3.0.0-alpha-1
    • Component/s: None
    • Labels:
      None

      Description

      When creating a new replication peer the ReplicationSourceManager enqueues the currently open HLog to the ReplicationSource to ship to the destination cluster. The ReplicationSource starts at the beginning of the HLog and ships over any pre-existing writes.

      A workaround is to roll all the HLogs before enabling replication.

      A little background for how it affected us - we were migrating one cluster in a master-master pair. I.e. transitioning from A <-> B to B <-> C. After shutting down writes from A -> B we enabled writes from C -> B. However, this replicated some earlier writes that were in C's HLogs that had originated in A. Since we were running a version of HBase before HBASE-7709 those writes then got caught in a infinite replication cycle and bringing down region servers OOM because of HBASE-9865.

      However, in general, if one wants to manage what data gets replicated, one wouldn't expect that potentially very old writes would be included when setting up a new replication link.

        Attachments

        1. HBASE-9888.branch-1.001.patch
          16 kB
          Pankaj Kumar
        2. HBASE-9888.branch-1.002.patch
          17 kB
          Pankaj Kumar
        3. HBASE-9888.patch
          18 kB
          Pankaj Kumar
        4. HBASE-9888.branch-2.patch
          18 kB
          Pankaj Kumar
        5. HBASE-9888.branch-2.002.patch
          18 kB
          Pankaj Kumar
        6. HBASE-9888.002.patch
          18 kB
          Pankaj Kumar
        7. HBASE-9888.branch-2.patch
          18 kB
          Michael Stack
        8. HBASE-9888.003.patch
          16 kB
          Pankaj Kumar

        Issue Links

          Activity

            People

            • Assignee:
              pankaj2461 Pankaj Kumar
              Reporter:
              davelatham Dave Latham

              Dates

              • Created:
                Updated:

                Issue deployment