Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-17543

Create additional ReplicationEndpoint WALEntryFilters by configuration

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.0, 2.0.0
    • Replication
    • None
    • Reviewed

    Description

      The existing BaseReplicationEndpoint creates a ChainWALEntryFilter containing a NamespaceTableCfWALEntryFilter and a ScopeWALEntryFilter. Adding a custom WALEntryFilter type to this chain requires creating an entirely new ReplicationEndpoint subclass and creating a new peer on the running cluster, which can be operationally complex to transition to without data loss in cases such as master/master.

      For WALEntryFilters without constructor parameters, it would be straightforward to have a Configuration option to list additional WALEntryFilter classes the operator wants to include in the filter chain in the default endpoint, and then have the endpoint instantiate the filters via reflection. Then filter logic could be added (or removed) with only a hbase-site.xml change and a rolling restart.

      Attachments

        1. HBASE-17543.patch
          5 kB
          Geoffrey Jacoby
        2. HBASE-17543.v2.patch
          9 kB
          Geoffrey Jacoby
        3. HBASE-17543.v3.patch
          9 kB
          Geoffrey Jacoby
        4. HBASE-17543-branch-1.patch
          10 kB
          Geoffrey Jacoby

        Activity

          People

            gjacoby Geoffrey Jacoby
            gjacoby Geoffrey Jacoby
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: