[GOBBLIN-1821] Allow flow execution ID from GaaS to propagate into job IDs from Gobblin Cluster

• Type: Improvement
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Component/s: gobblin-cluster
• Assignee: Hung Tran
• Reporter: William Lo
• Created: 21/Apr/23 18:52
• Updated: 24/Apr/23 17:48

Description

When Gobblin-as-a-Service sends a job to Gobblin cluster, the Gobblin cluster will create a new Job ID to identify the job. This makes it difficult to associate the job with the flow that kicked off the job in Gobblin-as-a-Service. Given this, it makes it difficult to associate jobs with the flow that sent them.