[HIVE-21762] REPL DUMP to support new format for replication policy input to take included tables list.

• Type: Sub-task
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 4.0.0-alpha-1
• Component/s: repl
• Labels: DR Replication pull-request-available
• Target Version/s: 4.0.0
• Assignee: Sankar Hariappan Assign to me
• Reporter: Sankar Hariappan
• Created: 21/May/19 07:34
• Updated: 17/Nov/22 08:50
• Resolved: 13/Jun/19 16:25

Description

• REPL DUMP syntax:

  REPL DUMP <repl_policy> [FROM <last_repl_id> WITH <key_values_list>;
  

• New format for the Replication policy have 3 parts all separated with Dot (.).
  1. First part is DB name.
  2. Second part is included list. Comma separated table names/regex with in square brackets[]. If square brackets are not there, then it is treated as single table replication which skips DB level events.
  3. Third part is excluded list. Comma separated table names/regex with in square brackets[].

  <db_name> -- Full DB replication which is currently supported
  <db_name>.['.*?']  -- Full DB replication
  <db_name>.[] -- Replicate just functions and not include any tables.
  <db_name>.['t1', 't2']  -- DB replication with static list of tables t1 and t2 included.
  <db_name>.['t1*', 't2', '*t3'].['t100', '5t3', 't4'] -- DB replication with all tables having prefix t1, with suffix t3 and include table t2 and exclude t100 which has the prefix t1, 5t3 which suffix t3 and t4.
  

• Need to support regular expression of any format.
• A table is included in dump only if it matches the regular expressions in included list and doesn't match the excluded list.

Issue Links

• links to: GitHub Pull Request #664