[GOBBLIN-1387] Email Notifications for failures not sending

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.16.0
• Fix Version/s: 0.17.0
• Component/s: gobblin-core
• Assignee: Abhishek Tiwari
• Reporter: William Lo
• Created: 10/Feb/21 23:27
• Updated: 14/Jun/23 04:13

Description

Email notifications look into JOB_FAILURES_KEY, which is set by DatasetState.
JobContext's reference to it's own jobState is misleading here as it does not track dataset state failures (in terms of amounts, only if it is passed/failed).

Add a function to track the dataset state failures from jobContext