Details
-
Sub-task
-
Status: Closed
-
Major
-
Resolution: Duplicate
-
3.0.0
Description
Add new EVENT_COMMIT_TXN to log the metadata/data of all tables/partitions modified within the txn.
Source warehouse:
- Create EVENT_COMMIT_TXN event type with corresponding message format etc.
Target warehouse:
- Repl load should read this event from the dump.
- Validate the source txn ID from the event using the Source-Target Txn ID map maintained in target metastore. Also, need to check if corresponding target txn ID is valid.
- If valid, then apply the event and commit the corresponding target transaction.
- This new event should be idempotent such that if it is applied twice, then second time it should be loop.
Attachments
Issue Links
- links to