[GOBBLIN-1970] Consolidate Processing Dag Actions to Single Code Path

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: gobblin-service
• Assignee: Abhishek Tiwari
• Reporter: Urmi Mustafi
• Created: 04/Dec/23 18:48
• Updated: 15/Dec/23 19:10

Description

We have similar code in the DagActionStoreChangeMonitor and DagManager to process dag actions from the DagActionStore. There have been small discrepancies between the code in each area leading to unexpected bugs in how the actions are processed, so to fix forward and make this easier to maintain with code in one place we consolidate all logic relating to the dag action processing to the DagActionStoreChangeMonitor. The processing in the change monitor is working correctly, while the handling of launch events in the DagManager is failing compilation most likely due to an error loading the job templates when initializing the compiler but we're not able to identify the exact issue.