Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0, 2.0.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      As mentioned in parent issue, and design docs for phase-1 (HBASE-10070) and Phase-2 (HBASE-11183), implement asynchronous WAL replication from the WAL files of the primary region to the secondary region replicas.

      The WAL replication will build upon the pluggable replication framework introduced in HBASE-11367, and the distributed WAL replay.

      Upon having some experience with the patch, we changed the design so that there is only one replication queue for doing the async wal replication to secondary replicas rather than having a queue per region replica. This is due to the fact that, we do not want to tail the logs of every region server for a single region replica.

      Handling of flushes/compactions and memstore accounting will be handled in other subtasks.

        Attachments

        1. 11568-2-branch-1.txt
          109 kB
          Devaraj Das
        2. 11568-branch-1.txt
          109 kB
          Devaraj Das
        3. hbase-11568_v2.patch
          105 kB
          Enis Soztutar
        4. hbase-11568_v3.patch
          106 kB
          Enis Soztutar

          Issue Links

            Activity

              People

              • Assignee:
                enis Enis Soztutar
                Reporter:
                enis Enis Soztutar
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: