[GOBBLIN-1937] Quantify Missed Work Completed by Reminders

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: gobblin-service
• Assignee: Abhishek Tiwari
• Reporter: Urmi Mustafi
• Created: 25/Oct/23 23:08
• Updated: 27/Oct/23 20:04

Description

Measure the amount of work that would have been missed by a participant otherwise completed by the reminder event concept. This can be done by checking the number of reminder events that actually obtain a lease to re-trigger a flow launch. Reminder events that see another lease is in progress are not included to avoid double counting the participant actually doing the work on reminder case. 

Additionally, address a bug to filter out heartbeat events before attempting to extract the FlowActionType from DagActionStoreChangeEvents because heartbeat events have null FlowActionTypes, causing the heartbeats to be rightfully skipped but for the wrong reason.