[HBASE-19494] Create simple WALKey filter that can be plugged in on the Replication Sink

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 2.0.0-beta-1, 2.0.0
• Component/s: Replication
• Hadoop Flags: Reviewed

Release Note

Adds means of adding very basic filter on the sink side of replication. We already have a means of installing filter source-side, which is better place to filter edits before they are shipped over the network, but this facility is needed by hbase-indexer.

Set hbase.replication.sink.walentrysinkfilter with a no-param Constructor implementation. See test in patch for example.

• Assignee: Michael Stack
• Reporter: Michael Stack
• Created: 12/Dec/17 05:50
• Updated: 21/Mar/18 22:20
• Resolved: 19/Dec/17 21:50

Description

hbase-indexer used to look at WALKeys on the sink to see if their time of creation was before the time at which the replication stream was enabled.

In the parent redo, there is no means for doing this anymore (because WALKey used to be Private and because to get at the WALKey in the Sink, you had to override all of the Replication which meant importing a million Private objects...).

This issue is about adding a simple filter to Replication on the sink-side that just takes a WALKey (now InterfaceAudience LimitedPrivate and recently made read-only).

Assigned myself. Need to do this so hbase-indexer can move to hbase2.

Issue Links

• links to: Review Board (master)