[HBASE-1733] Pluggable replication framework

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Component/s: Replication
• Assignee: Unassigned
• Reporter: Andrew Kyle Purtell
• Created: 02/Aug/09 23:45
• Updated: 11/Jun/22 21:01
• Resolved: 12/May/14 00:32

Description

Put minimal support for replication into core and plan for the rest in contrib/. Support in core can look like:

1. Scope tags in WAL and HCD (HBASE-1728, HBASE-1834). Generic integer, sufficient for any number of schemes.

and handled in this issue:

2. Method to register remote watchers on WAL rolls, via watcher in ZK. So this is basically distributed upcall to the listeners on roll.

3. Mechanism to prevent HLog from cleaning rolled logs until all listeners have finished with it, also implemented with ZK. Could only delete when no more ephemeral subnodes on the log node, where region server would hold an entry also and delete its entry when edit content has made it out to the storefiles.