[GOBBLIN-1673] [Helix Dynamic Workunit] Message Schema for splitting workuntis

• Type: New Feature
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: gobblin-helix
• Assignee: Abhishek Tiwari
• Reporter: Matthew Ho
• Created: 02/Aug/22 18:55
• Updated: 12/Sep/22 16:56

Description

For the Helix Dynamic Workunits, task runners will produce messages indicating the current workunit health and the application master will consume these messages.

A message will be sent from the task runner to the AM when the task runner experiences lag during ingestion. This ticket is the schema proposal for this message.