Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Fixed
-
None
-
None
Description
Currently ReplicationZookeeper maintains all the zookeeper state for replication. This makes the class relatively large and slightly confusing. There are three major pieces of zookeeper state maintained for replication:
1. The state of replication (i.e. whether replication is ENABLED or DISABLED on the cluster). This is held in the state znode.
2. The set of slave (or peer) clusters that replication needs to ship edits to. This is held in the peer znode.
3. The replication queues that keep track of which hlog files still need to be replicated. There is one queue for each replication source/peer cluster pair.
Splitting each of these three pieces into their own interfaces will separate the implementation from the operations needed to manipulate replication state. This will allow easier unit testing of the replication logic and more flexibility for future implementations of how replication state is stored.
The plan is to implement these changes as a series of patches (at least one for each of the three interfaces). The state interface will be first, since it is the most easily separable from the other two pieces.
Attachments
Attachments
Issue Links
- depends upon
-
HBASE-8439 [replication] Remove ReplicationZookeeper class
- Closed
-
HBASE-7567 [replication] Create an interface for replication peers
- Closed
-
HBASE-7568 [replication] Create an interface for replication queues
- Closed
-
HBASE-8441 [replication] Refactor KeeperExceptions thrown from replication state interfaces into replication specific exceptions
- Closed
-
HBASE-8440 [replication] Rename ReplicationStateInterface and ReplicationStateImpl
- Closed
-
HBASE-8149 [replication] Add more unit tests for new replication state interfaces
- Closed