[HBASE-10504] Define Replication Interface

• Type: Task
• Status: Resolved
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 2.0.0
• Component/s: Replication
• Hadoop Flags: Reviewed

Release Note

Adds a new plugin point ReplicationEndpoint. ReplicationSource, internal to hbase, tails the WAL and calls registered ReplicationEndpoints. ReplicationEndpoint implementations are responsible for actually shipping the edits to the other (hbase or non-hbase) cluster. ReplicationEndpoint can be defined per peer. Default inter-cluster replication works without any changes (lily etc should still work). ReplicationEndpoints have various facility including means for filtering out WAL edits source-side before they can be shipped to remote peers.

• Assignee: Enis Soztutar
• Reporter: Michael Stack
• Created: 11/Feb/14 23:36
• Updated: 19/Sep/17 05:41
• Resolved: 19/Sep/17 05:39

Description

HBase has replication. Fellas have been hijacking the replication apis to do all kinds of perverse stuff like indexing hbase content (hbase-indexer https://github.com/NGDATA/hbase-indexer) and our Francis Christopher Liu just showed up w/ overrides that replicate via an alternate channel (over a secure thrift channel between dcs over on HBASE-9360). This issue is about surfacing these APIs as public with guarantees to downstreamers similar to those we have on our public client-facing APIs (and so we don't break them for downstreamers).

Any input Patrick D. Hunt or Gabriel Reid or Francis Christopher Liu?

Thanks.

Issue Links

• is related to: HBASE-15982 Interface ReplicationEndpoint extends Guava's Service
• relates to: HBASE-9507 Promote methods of WALActionsListener to WALObserver

Sub-Tasks

• Pluggable replication endpoint: Closed
• add/remove peer requests should be routed through master: Resolved
• Replication TableCfs should be a PB object rather than a string: Resolved
• enable/disable replication peer requests should be routed through master: Resolved
• get/update replication peer config requests should be routed through master: Resolved
• list replication peers request should be routed through master: Resolved
• Move ReplicationPeer and other replication related PB messages to the replication.proto: Resolved
• Convert all internal usages from ReplicationAdmin to Admin: Resolved
• Move most of the replication related classes from hbase-client to hbase-replication package: Resolved
• Move listReplicated/enableTableRep/disableTableRep methods from ReplicationAdmin to Admin: Resolved
• Mark ReplicationAdmin's peerAdded and listReplicationPeers as Deprecated: Resolved